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Abstract. An explicit bilinear generating function for Meixner-PoUaczek polynomials is proved. 
This formula involves continuous dual Hahn polynomials, Meixner-PoUaczek functions, and non- 
polynomial 3_F2-hypergeometric functions that we consider as continuous Hahn functions. An inte- 
gral transform pair with continuous Hahn functions as kernels is also proved. These results have 
an interpretation for the tensor product decomposition of a positive and a negative discrete series 
representation of su(l, 1) with respect to hyperbolic bases, where the Clebsch-Gordan coefficients 
are continuous Hahn functions. 



1. Introduction 

The results and techniques in this paper are mainly analytic in nature, but they are motivated 
by a Lie algebraic problem. As is well known, many polynomials in the Askey-scheme of orthogonal 
polynomials of hyper geometric type, see [T^, have an interpretation in the representation theory 
of Lie groups and Lie algebras, see e.g. Vilenkin and Klimyk [221 Koornwinder |16j . The 
Askey-scheme can be extended to families of unitary integral transforms with a hyper geometric 
kernel. Many of these kernels also admit group theoretic interpretations. For example the Jacobi 
functions, which can be considered as a non-polynomial extension of the Jacobi polynomials and are 
given explicitly by a certain 2i^i-hypergeometric function, have an interpretation as matrix elements 
for irreducible representations of the Lie group SU{1, 1). The Jacobi function is the kernel in the 
Jacobi integral transform, which can be found by spectral analysis of the hypergeometric differential 
operator. For an overview of Jacobi functions in representation theory, we refer to the survey paper 
jl7j by Koornwinder. 

In this paper we give a generalization of the Jacobi functions. We consider the tensor product 
of a positive and a negative discrete series representation of the Lie algebra su(l, 1). The Clebsch- 
Gordan coefficients for the hyperbolic basisvectors turn out to be a certain type of non-polynomial 
3i<2-hypergeometric functions, which we call continuous Hahn functions. We show that the contin- 
uous Hahn functions are the kernel in an integral transform, that generalizes the Jacobi function 
transform. We emphasize that the main part (sections Ol and |SJ of this paper is analytic in nature, 
and that the Lie algebraic interpretation is mainly restricted to section [l] 

The Lie algebra su(l, 1) is generated by the three elements H, B and C. There are four classes 
of irreducible unitary representations for su(l, 1): discrete series, i.e. the positive and the negative 
discrete series representations, and continuous series, i.e. the principal unitary series and the com- 
plementary series representations. There are three kinds of basis elements on which the various 
representations can act: the elliptic, the parabolic and the hyperbolic basis elements. These three 
elements are related to conjugacy classes of the group SU (1,1). We consider the tensor product of a 
positive and a negative discrete series representation, which decomposes into a direct integral over 
the principal unitary series representations. Under certain condition discrete terms can appear. 
The Clebsch-Gordan coefficients for the standard (elliptic) basis vectors are continuous dual Hahn 
polynomials. We compute the Clebsch-Gordan coefficients for the hyperbolic basis vectors, which 
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are non-polynomial extensions of the continuous (dual) Hahn polynomials, and are therefore called 
continuous Hahn functions. For the Clebsch-Gordan coefficients for the elliptic and parabolic basis, 
we refer to jTO], respectively |SI, 0- 

The explicit expressions for the Clebsch-Gordan coefficients as 3i<2-series are not new, they are 
found by Mukunda and Radhakrishnan in |19j . However not much seems to be known about the 
generalized orthogonality properties of the continuous Hahn functions, i.e. they form the kernel in a 
unitary integral tranform (the continuous Hahn transform). Using the Lie algebraic interpretation 
of the continuous Hahn functions, we can compute formally the inverse of the continuous Hahn 
integral transform. In section El we give an analytic proof for the integral transform pair. 

The method we use to compute the Clebsch-Gordan coefficients is based on an idea by Granovskii 
and Zhedanov [S]. The idea is to consider a self-adjoint Lie algebra element Xa = —aH + B — C, 
a e M. The action of X a in an irreducible representation gives a difference equation, for which the 
(generalized) eigenvectors can be expressed in terms of special functions and the standard basis 
vectors. The Clebsch-Gordan coefficients for the eigenvectors can be calculated using properties of 
the special functions. In |26j and [iSj Van der Jeugt and the second author considered the action 
of Xa in tensor products of positive discrete series representations of 5u(l, 1) to find convolution 
formulas for orthogonal polynomials. In ^0] the action of Xa in the tensor product of a positive 
and a negative discrete series representation is investigated for |a| > 1 (the elliptic case). This leads 
to a bilinear summation formula for Meixner polynomials |10n Thm.3.6]. In this paper we consider 
the case |a| < 1 (the hyperbolic case). 

The plan of the paper is as follows. In section [2 we introduce the special functions we need in 
this paper, and give some properties of these functions. 

In section 121 we prove a bilinear summation formula for Meixner-Pollaczek polynomials by series 
manipulations. As a result we find a certain type of 3-F2-functions, which are the continuous Hahn 
functions. The summation formula is used in section ET^ to compute the Clebsch-Gordan coefficients 
for the hyperbolic bases. 

In section we consider the tensor product of a positive and a negative discrete series represen- 
tation of the Lie algebra su(l, 1). First we recall the basic properties of su(l, 1) and its irreducible 
unitary representations in section Then in section we diagonalize Xa, \a\ < 1, in the various 
irreducible representations. This leads to generalized eigenvectors of Xa, which can be considered 
as hyperbolic basis vectors. 

For the discrete series representations, the overlap coefficients for the eigenvectors and the stan- 
dard (elliptic) basisvectors are Meixner-Pollaczek polynomials, cf. |16| §7]. For the continuous series, 
the overlap coefficients are Meixner-Pollaczek functions. This follows from the spectral analysis of 
a doubly infinite Jacobi operator, which is carried out by Masson and Repka |18[ §3.3] and Koelink 
|14| §4.4.11]. It turns out that the spectral projection of the Jacobi operator is on a 2-dimensional 
space of generalized eigenvectors. So the eigenvectors of Xa, \a\ < 1, in the continuous series repre- 
sentations are 2-dimensional, and we find two linearly independent Meixner-Pollaczek functions as 
overlap coefficients. To determine the Clebsch-Gordan coefficients for the hyperbolic bases, we use 
the bilinear summation formula from section O This leads to a pair of continuous Hahn functions 
as Clebsch-Gordan coefficients. By formal calculations we find an integral transform pair, with a 
pair of continuous Hahn functions as a kernel. To give a rigorous proof of the integral transform 
pair, we show that the continuous Hahn functions are eigenfunctions of a difference operator A. To 
find this operator A we realize H, B and C as difference operators acting on polynomials, using the 
difference equation for the Meixner-Pollaczek polynomials. Then A is a restriction of the Casimir 
operator in the tensor product. 

The spectral analyis of this difference operator is carried out in section [21 A main problem 
with spectral analysis of a difference operator is finding the right eigenfunctions. This is because 
an eigenfunction multiplied by a periodic function is again an eigenfunction. Our choice of the 
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periodic function is mainly motivated by the Lie algebraic interpretation of the eigenfunctions. 
Using asymptotic methods, we find a spectral measure for the difference operator. This leads to an 
integral transform with a pair of continuous Hahn functions as a kernel. We call this the continuous 
Hahn integral transform. 

Notations. We denote for a function / : C ^ C 



nx) = fix). 

If dfi{x) is a positive measure, we use the notation dfi2 (x) for the positive measure with the property 

d(/U2 X ^2)(x,x) = dfj,{x). 
The hypergeometric series is defined by 

'ai, . . . , Op _ \ _ (ai)n • • • {ap)n z"' 



^ ^ bi,...,bg '~J {bi)n ■ . . {bg)n n\ 

where (a)„ denotes the Pochhammer symbol, defined by 

ia)n = A = a(a + + 2) . . . (a + n - 1), n G Z>o. 

r(a) 
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2. Orthogonal polynomials and functions 

In this section we recall some properties of the orthogonal polynomials and functions which we 
need in this paper. 

Continuous dual Hahn polynomials. The Wilson polynomials, see Wilson or ^ §3.8], 
are 4-F3-hypergeometric polynomials on top of the Askey-scheme of hypergeometric polynomials, 
see Koekoek and Swarttouw The continuous dual Hahn polynomials are a three-parameter 

subclass of the Wilson polynomials, and are defined by 

Sniy;a,b,c) = {a + b)n{a + c)n3F2 ( ""'""^^^'^ x^ = y, (n G Z>o). (2.1) 

\ a + b,a + c J 

For real parameters a, b, c, with a + 6, a + c, 6 + c positive, the continuous dual Hahn polynomials 
are orthogonal with respect to a positive measure, supported on a subset of M. The orthonormal 
continuous dual Hahn polynomials are defined by 

c, / , N {-'^Tsn{y;a,b,c) 
Sn{y;a,b,c) - 



y/nl{a + b)n{a + c)„(6 + c)„ 



By Kummer's transformation, see e.g. 01, Cor. 3.3.5], the polynomials Sn and Sn are symmetric in 
o, b and c. Without loss of generality we assume that a is the smallest of the real parameters a, b 
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and c. Let dii{-; a, b, c) be the measure defined by 



/ 







r(a + ix)T{b + ix)T{c + ix) 



T{2ix) 



2 



fix' 



T{a + b)T{a + c)T{b + c 



dx 



Tjb- a)r{c- a) ^ ^ (2a)fc(a + l)fc(a + b)fc(a + c)fc 2^ 
^r(-2a)r(6 + c) ^ (a)fc(a-6+l)fc(a-c + l)fcA;!-'^ I + 



where X is the largest non- negative integer such that a + K < 0. In particular, the measure 
dfj,{-; a, b, c) is absolutely continuous if a > 0. The measure is positive under the conditions a+b > 0, 
a + c > and 5 + c > 0. Then the polynomials Sn{y', a, b, c) are orthonormal with respect to the 
measure dfi{y; a, b, c). 

Meixner-Pollaczek polynomials. The Meixner-Pollaczek polynomials, see |13j . ^ Ex. 6. 37], 
are a two-parameter subclass of the Wilson polynomials, and are defined by 



(2.2) 



For A > and < (f) < tt, these are orthogonal polynomials with respect to a positive measure on 
M. The orthonormal Meixner-Pollaczek polynomials 



(2.4) 



satisfy the following three-term recurrence relation 

2xsm<j)Pnix) = anPn+iix) - 2(n + A) cos0P„(x) + a„„iP„_i(x), (2.3) 

where 

On = V(" + 1)(" + 2A). 
The Meixner-Pollaczek polynomials also satisfy the difference equation 

e*'^(A — ix)y{x + i) + 2i[x cos (j) — {n + X) sin (p]y{x) — e~*'^(A + ix)y{x — i) = 0, 

y(x) =pW(x;(/<). 

Define 

.,W(x;0) = ^(2-n^)^^e(2^-)^H^±^, 
then the orthonormality relation reads 

pW(rE;0)pW(^.^)^„(A)(^.^)^^ = 5^^. 

Meixner-Pollaczek functions. The Meixner-Pollaczek functions ii„, n G Z, can be considered 
as non-polynomial extensions of the Meixner-Pollaczek polynomials, see Masson and Repka ^H] 
and Koelink 114?, §4.4]. The Meixner-Pollaczek functions are defined by 



( X A\ C,- ■ ^^-n + 1 + £ + A)r(n + £ - A) 

Un{x\ A, e, 0) = (2i sm 0) — — — — — 

r(n -h 1 -h e - «x) 5-) 

^/n + l + e + A,n + e-A 1 \ , 

n + l + .-^x 'T3^J' (-^^)- 

The parameters <^ and e satisfy the conditions 0<(/'<7r,0<e<l, and A satisfies one of the 
following conditions: —\ < A < — e, —\ <A<e — 1, orA = —\ + ip, p ^ M. In the last case m„ 
is symmetric in p and — /), so without loss of generality we assume p > 0. For < (/) < ^vr and 
Itt < (/) < TT we use the unique analytic continuation of the 2-^1-function to C \ [1, 00). Note that 
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the Meixner-Pollaczek function is well defined for all n G Z, since r(c)^^2-^i(fl) b; c; z) is analytic in 
a, b and c. 

The functions Un and li* satisfy the recurrence relation 

2xsm(l)Un{x) = a„n„+i(x) + PnUn{x) + a„_iti„-i(x), (2.6) 

where 

an = ■\/{n + e + X + l){n + e - X), /3„ = 2(n + e) cos (p. 
Let L be the corresponding doubly infinite Jacobi operator acting on ^^(Z), 

L : anCn+l + + «n-ien~l- 

L is initially defined on finite linear combinations of the basis vectors of ^^(Z), and then L is 
essentially self adjoint. The spectral measure of L is described by 

{^,v) = ^ [ ({u,U{x)){U{x),v) + {u,U*{x)){U*{x),v) 

-wi{x){u,U{x)){U*{x),v) - wl{x){u,U* {x)){U{x),v))wo{x)dx, 



where 



wi{x) 

Wq{x) 



T{X + l + ix)r{-X + ix) 



T{ix-e)T{l + e-ix) 
|r(A + 1 - ix)T{-X - ix)T{ix - e)r(l + £- ix)\^ 

\r{ix - e)r{i + £-ix)\^- |r(A + 1 - ix)r{-x - ix)\^ 

(2sin0)-^^e^"('^-i) 

^ r{-e - A)r(l + A - e)r(l + A + e)r(e - A) 

= (2sin</))-2-e2-(<^-i), 

oo oo 

U{x) = ^ Un{x;X,e,(j))en, U*{x)= ^ u* (x; A, e, (/))en. 

n=— oo n=— oo 

The spectral measure for L can be obtained from 14, §4.4.11], using the connection formulas given 
there. The expression for wo{x) is found using Euler's refiection formula, elementary trigonometric 
identities and the conditions on A. 

Let Ti. = TC{X,e,(l)) be the Hilbert space consisting of functions 

7i(x) 



f : 



f2{x: 



with inner product defined by 



Observe that the square matrix inside the integral is positive definite and self adjoint. 
Proposition 2.1. The functions 

( Ur 

form an orthonormal basis of the Hilbert space TC. 

The orthonormality follows by choosing u and v above as standard basis vectors e„ and em- 
The completeness of the Meixner-Pollaczek functions follows from the uniqueness of the spectral 
measure. An alternative, group-theoretic approach, can be found in ^7\. It is only worked out for 
the smaller range of parameters corresponding to SU(1, 1) (rather than its Lie algebra or universal 
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covering group). We will briefly describe how the analytic arguments that lie behind the approach 
of 122] extend to the present situation. We only discuss the case A = — ^ + ip, p G M, which is all 
that we need later. 

Consider the space L^(T) on the unit circle with respect to normalized measure |(iz|/27r. It has 
the orthonormal basis en{z) = z", n G Z. If A = — ^ +Z/0, p € M and e G M, it is easily checked that 



iUf)ix) = 
defines an isometry U : L^(T) 

fix 



1 



(x + i) 



vr 



"2 p e 



X 



X + I 



Next we recall that the Mellin transform, defined by 



gives an isometry L^(M_|_) 
isometry 

given by 



2tt Jo 

. Thus, we may define a "double" Mellin transform as the 



V : 



L^(]R) 



iVf)ix) 



Io^fiy)y'''-^dy 
2^\!^f{-y)y''^-Uy^ 



If we now let T^, t G R, denote the translation operator (Ttf){x) = f{x + t), we may compose 
the above isometrics to obtain the orthonormal basis 



{VoTtoU){er, 



of L2 



L2 



Explicitly, we have 



ftix) 



1 



it + i±yy 



'{t-i±y) 



X+n+e yix- 



dy. 



These integrals may be expressed in terms of Gauss's hypergeometric function; cf. 27, §7.7.3]. 
Using Kummer's identities [HI §2.9], one may then express fl^ in terms of Un{x + p) and u*^{x + p), 
where e^*"^ = (t + i)/{t — i). Rewriting the identity (fn,fm) = ^nm in terms of Meixner-Pollaczek 
functions and making a final change of variables x i-^ x — p, one recovers the orthonormal basis u„. 

The group-theoretic interpretation of this proof is the following. The space L^(T) is a natural 
representation space for the principal unitary series (e^ is proportional to the e„ in (|4.5() below). 
The operator L gives the action of a hyperbolic Lie algebra element; cf. also §4.2. It generates a 
one-parameter subgroup of the universal covering group of SU(1, 1), which locally may be identified 
with the group of linear fractional transformations of the circle that have two common fix-points. 
Thus, L^(T) splits into two invariant subspaces. The map o U corresponds to mapping the 
fix-points to {0, oo}, and the one-parameter subgroup to dilations of M. Finally, the operator V 
is the Fourier transform with respect to these dilations. In particular, the appearance of double 
eigenvalues in Proposition 12. II has a natural geometric explanation: it corresponds to the fact that 
a circle falls into two pieces when removing two points. 



3. A BILINEAR SUMMATION FORMULA 

In this section we prove a bilinear summation formula for Meixner-Pollaczeck polynomials. This 
summation is related to the tensor product of a positive and a negative discrete series representation 
of the Lie algebra su(l, 1), which will be explained in section [l] In the summation a certain type 
of non-polynomial 3i<2-functions appear. These functions will be investigated in section |SJ 
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Theorem 3.1. For G supp dp,{-; k2 — ki + ^,ki + k2 — \,ki — k2 + p + \), p ^ "L, xi,X2 ^"^j 
and ki,k2 > 0, the Meixner-PoUaczek polynomials and the continuous dual Hahn polymials satisfy 
the following summation formula 

C ^ (2fci)p+„(2fc2)n ''"^^'' ^2 - ^1 + 2' ^1 + ^2 - 2 > ^1 - ^2 + P + -)p'^!:ll{xi-4>)P^^^\x2] 4>) = 



,_^.p r(i(xi -X2) + \ + ip)T{i{xi -X2) + \- ip) 

r(A:2 -ki + i{xi - X2) + l)r(A;i - /cg + i{xi - xa) + 1 + p) 
^ { k2- ix2, k2 - ki + h + ip, k2 - ki + h - ip ^ 
\ 2k2,k2 - ki +i[xi - X2) + 1 



X 2F1 
+ 



p + fci - /C2 + ^ + «/0, p + /ci - A;2 + i - _ 1 



ki — k2 + i{xi — X2) + p+1 ' 1 _ e 2i</> 

r(i(2;2 - xi) + i + ip)T{i{x2 - xi) + ^ - ip) 



T{k2 - ki + i{x2 - xi) + l)r(/ci - k2 + i{x2 - xi) + I + p) 
^ ^ / k2 + ix2, k2 - ki + \ + ip,k2 - ki + \ - ip ^ 
^ 2k2,k2 - ki + i{x2 - xi) + 1 

/p + A;i - A;2 + i + + /ci - /c2 + i - ip 1 



/^i — ^2 + i{x2 — xi) + p + 1 ' 1 — e^*?^ 

w/iere 

g-2xi(</,-|)^,p(2A;i) 



iP (2 sin (/))2^i+Pr(/i;i + ixi)r(A;i - ixi) ' 
Here we use the convention that if pn is a polynomial of degree n, then = for n G N. 

Remark 3.2. (i) The 2-^1-series on the right hand side are Meixner-Pollaczek functions, as defined 
by 1)2. 5() . The 3i<2-series on the right hand side can be considered as continuous Hahn functions, 
see section [SJ 

(ii) Theorem 13. II is a non-polynomial extension of jlOl Thm.3.6]. Replacing ki + ixi, /c2 + ix2, 
g2i0^ p2 -j^ Theorem I3.1l bv xi, X2, c, y respectively, and restricting the new xi and X2 to negative 
integers makes one term on the right hand side vanish, and we obtain |1UI Thm.3.6]. 

(iii) There is an interesting limit case of the summation of Theorem 13. H for xi — X2 > 

Y. Ckl' (9k ^ k2-k, + -,k, + k2--,k,-k2+p+ -)L^^ll-'\xr)L^t'-'\x2) = 



„=o(2^l)p+n(2/C2M 



T{2k^)e^^2Fi 



ki + k2 - h + ip, ki + k2 - h 



ip X2 



2k2 X2 - Xi 



X (xi - X2)''^^''^~^''^U{p + ki-k2 + - + ip;l + 2ip; xi - X2), 

where Ln"^ is a Laguerre polynomial as defined in and U{a;b;z) denotes the second solution 
of the confluent hypergeometric differential equation in the notation of Slater 124' : 

... , N r(l-6) ^ /a \ T(b-1) . f, ^ fl + a-b 
U{a;h;z) = > .F^(-,z]+ ^.n^ 1-^1 o . 5^ 



T{l + a-b)' '\b ' J r(a) ' ' V 2-6 

This formula is obtained from Theorem 13.11 as follows. We replace Xj by — Xj/20, i = 1,2, and 
transform the 2-^1-series on the right hand side by ^ (2.3.12)]. Then we let (j) ^ 0. Here Stirling's 



8 WOLTER GROENEVELT, ERIK KOELINK, AND HJALMAR ROSENGREN 

formula is used, Euler's transformation is used for the 2-^1-series which are obtained from the 2,^2- 
series, and Kummer's transformation :24, (1.4.1)] is used for the i-Fi-series which are obtained from 
the 2-^1-series. This hmit case can also be obtained by Lie algebraic methods, see (HI Thm.3.10]. 

(iv) Note that from 

Sn(/0^; ki-k2 + ]r,ki + k2-\,k2-ki-p+\) = 

1 1 1 1 (^-l) 

(-l)P|(/ci -k2 + - +ip)p\'^Sn-p{p^]k2 -ki + -,ki + k2- -,ki - k2 + p + -), 

see |1U1 (3.13)], it follows that the sum on the left hand side of Theorem 13.11 is invariant under 
ki k2, Xi ^ X2, p ^ —p- 

(v) It is interesting to compare Theorem 3.1 with the results of [T]P, where summation formulas 
with a similar, but simpler, structure are obtained for various orthogonal polynomials. The method 
used in [TT] is completely different from the method we use here. 



Proof of Theorem Vj.l\ We start with the sum on the left hand side, with orthonormal polynomials: 

00 

S = Y. Snip"-. k2-ki + -M + k2--M-k2+P + ^)Pi5j(xi; c^)Pit'\^ 



00 

[X2 

Z Z Z ■ ' 

n=0 

First we show that this sum converges absolutely. Writing out the summand i?„ explicitly gives 



o ..,-2.n^ r(2fc2+n)r(2fci+p + n) ^ ^ ^ 
r(n + l)r(n+p+l) 3i^2 2Fi2Fi 

where K \s a, constant independent of n. To find the asymptotic behaviour for n ^ 00 of the 
F-functions, we use the asymptotic formula for the ratio of two F-functions j2H §4.5] 

^|^ = z'^~''(l + 0(z-i)), Izl^oo, larg(z)l<7r. (3.2) 

The asymptotics for the 3i<2-function follows from transforming the function by |2, p. 15(2)] and 
using ()3.2() . This gives, for n ^ 00, 



3-C^2 



-n, ki + k2-\ + ip,ki + k2-\-ip \ ^ ^1 _fe,_fc2+ip^ 

2k2, 2ki+p ' y 



where Ci and C2 are independent of n. If p^ is in the discrete part of supp dp{-; k2 — ki + ^,ki + 
k2 — \,ki — k2+p+\)^ we assume without loss of generality that 9(p) > 0. In this case the second 
term in the transformation p. 15(2)] vanishes, so C2 = 0. 

The asymptotic behaviour of the 2-^1-functions follows from |2l 2.3.2(14)]. This gives, for < 
(j) < TT and n 00, 

2F1 ("^"^ ^^2^^' + 1 - = (Csn-'^i-*^^ + C4n-^'i+^^ie-("+f)(i-^"''')) (l + 0{n~')) , 

2F1 ( '"^^ 1 - e2^<^) = (C5 n-'^^--^ + Ce n-^^^+^^e-^^^"^""')) (l + 0{n-')) , 

where Cj, i = 3, . . . , 6, is independent of n. Since 5R(1 - e-2^<^) = 2sin2 > and xi,X2 G M, we 
find 

Rn = {Ki n-^+'P + K2 (l + 0{n-^)) , n ^ 00, 

and then for /) G M the sum S converges absolutely. In case p £ iM, we have K2 = and Q{p) > 0, 
and then S still converges absolutely. 
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Next we write out the polynomials in S as hypergeometric series, using (|'2.2|) and (|2.H) . and then 
we transform the 3-F2-series, using the first formula on page 142 of J^; 



3F2 



-n, k2 - ki + \ + ip,k2 - ki + \ - ip 
2k2,p + l 



{p + ki-k2 + ^- ip)n p ( -n, k2 - ki + ^ + ip,ki + k2 - ^ + ip \ 
(p+l)n 3 2^ 2k2,k2-ki + ^+ip-n-p ' J' 

By §2.9(27)] with {a,b,c,z) = {-n - p, ki + ixi,2ki,l - e'^''!') the 2i*'i-series for P^^p(xi;</)) is 
written as a sum of two 2-^1 -series 

f-n-p,ki+ixi 
'^'[ 2k, 

(l_e-2i'/')--i-fcir(2A:i)r(n + p+l) ^ / ki + ixi,l - ki + ixi 1 , ^, 



r(fci — irci)r(n + p + 1 + /ci + ixi) \n+p + l + ki+ ixi ' 1 — e ^^"^ 
,^„2^./,^n+p (1 - e^^'^)'"^-^^r(2fci)r(n + p + 1) f k, - zx,,l - k, - ix, ^ 1 



r(A;i + zxi)r(n + p + 1 + /ci — ixi) \ n + p + 1 + A;i — zxi 'l — e^*"?^^ 

Now the sum S splits according to this: S = Si + 82- 

First we focus on Si. Reversing the order of summation in the 2-^*'i-series of the second Meixner- 
Pollaczek polynomial and using Euler's transformation ^ (2.2.7)], gives 

f-n,k2 + iX2 2i^ 

e--"M - e-^)--^^i^;^±^ 2F1 - ' - 2"^- ; — ^ ) . (3.4) 

(2A;2)„ V l-k2-n-iX2 l-e 

Writing out the hypergeometric series as a sum, we get 



^1 ■ 1- ^ r(2A;i)^/p! {2ki) 

T{ki-ixi)T{p + l + ki+ixi) " 



^ ^ ^ ^ (^2 + ■ix2)nip + ki - k2 + ^ - ip)n{-n)j{k2 -ki + \+ ip)j{ki + k2 - ^ + ip)j 



n=o j=o i,m=Q n\ {p + I + ki + ixi)n f- (2A;2)j(/c2 -ki + ^ + ip-n-p)j 

(fcl + ia:i);(l - fci + iXi)i{k2 - -^3:2)^(1 - ^2 - iX2)m _ ^-2i(f>yl-m 

l\ {n + p + 1 + ki + ixi)i ml {1 - k2 - n - ix2)m 
Next we interchange summations 

00 n 00 00 

EE = EE. 

n=0 J=0 i=0 n=j 



then the sum over n becomes 



^ (ki - k2 + ^ - ip + p - j)n{k2 + ix2 - m) 



^ ^ {n- j)\{p+l + l + ki+ixi)n 

We substitute k ^ n — j, then we find by Stirling's formula for the summand i? of Si, for large j 
and k, 

R ^ c j^'-^^+pk-^2{j + ky^-^-"^ , 

where C is independent of k and j. So we see that the sum Si converges absolutely for ki—k2+p < 0, 
and ^TT < (f> < Ivr. Now the sum Ei is a multiple of a 2^1-series with unit argument, which is 
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summable by Gauss' summation formula j2* (46), p. 104]; 

{k2 - ki + ^ - p + ip)j{k2 + ix2 - m)jT{p + / + 1 + A;i + ixi)T{l + m + ^ + ixi - 1x2 + ip) 
T{1 + j + 2 + k2 + ix2 + ip)T{p + I + m + ki — k2 + ixi — 1x2) 

This gives 



(-1 _ „-2i<f>\-ki-ixi('i _ p2iij)\ix2-k2 



00 



^ T{l + m + i{xi-X2) + \ + ip){k2-ix2)m{ki+ixi)i{l-ki+ixi)i _2i^.-i-m 
^ T{p + l + m + l + ki-k2 + i{xi - X2))T{1 + k2 + \ + ixi+ ip) m\lV ^ 



l,m= 

E°° {k2 - ki + ^+ ip)j{ki + k2 - ^ + ip)j{k2 + 1x2 



j^o jl{2k2)jil + l + k2 + ixi+ip)j 

The sum over j is a 3-F2-series, which by Kummer's transformation ^ Cor. 3. 3. 5] becomes 

r(/ + i + A;2 + ixi + ip)T{l + m + i + i{xi - X2) - ip) 
T{k2 - ki + l + i{xi - X2) +1 + m)T{l + ki + ixi) 

( k2 - ki + \ + ip,k2 - ki + \ - ip,k2 - 1x2 + m 

^ 3-^2 I i ^ 

\ 2k2.,k2 — ki + 1 + i{xi — X2) + I + m 

Here we need the condition /ci > for absolute convergence. We write out the 3-F2-series explicitly 
as a sum over j and interchange summations 

00 00 00 

E =EE E ■ 

l,m,j=0 n=0 j=0 l+m=n 

For the sum over I + m = n we find 

(1- ki+ ixi)l{k2 - iX2 + j)m (1 + /C2 - fei + i{xi - X2) + j)n 



E 



l\ ml nl 

m+l=n 



Now Si reduces to a double sum, which splits as a product of two sums, and we obtain 

Si 



ip<j> (1 - e-2*'?^)-'=i-^^'i (1 - e2^?i)'^2-'=2r(i + i{xi - X2) + ip)T{\ + i{xi - X2) - ip) 



T{ki - ixi)T{ki + ixi)T{p + fci - ^2 + i{xi - X2) + l)r(/c2 - ki+ i{xi - X2) + 1) 
\ + i{xi - X2) +ip,\+ i{xi - X2) - ip _ 1 



xr(2A:i)./p! {2k{)p2F^ 



p + ki — k2 + i{xi — X2) + 1 ' 1 _ e 2«</> 



^ p f k2 - ki + \ + ip,k2 - ki + \ - ip,k2 - 1X2 _^ 
^ 2k2,k2 - ki+ i{xi- X2) + 1 

S2 is calculated in the same way as 5i, only for the first step [HI §2.10(4)] is used instead of 1)3.4(1 . 
Then we obtain 



T{i{x2 - xi) + ^ + ip)T{i{x2 - xi) + ^ - ip) 
T{k2 - ki + i{x2 - xi) + l)r(A;i - k2 + i{x2 - xi) + I + p) 
^ p fk2 + ix2, k2 - ki + \ + ip,k2 - ki + \ - ip 
^ 2/c2, ^2 - ^1 + ^(2^2 - a:;i) + 1 



X 2F1 



\ + i{x2 - xi) +ip,\ + i{x2 - xi) - ip 1 



ki — k2 + i{x2 — xi) +P+1 ' 1 — e^**^ 
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Finally using Euler's transformation for the 2-^1-series, using 

e'P't'il - e2^"^)-P = {-l)P{2i sin <j))-P, 

(1 - e-2^'^)-'^i(l - e^^'^)-'^^ = (2sin(/))-2'^i, 

and writing the polynomials in the normalization given by i|2.2j) and (|2.1|) . the theorem is proved. 
Let us remark that all the series used in the proof are absolutely convergent under the conditions 
e supp dfi{-; k2 — ki + ^, ki + k2 — ^, ki — k2 + p + |), xi, X2 G M, A;i > 0, ^ir < (f) < ^ir and 
^1 — ^2 + P < 0. The last condition can be removed using the symmetry (fci, k2,p) ^ {k2, ki, —p) 
and continuity in ki and /c2- Using the analytic continuation of the hypergeometric function, we 
see that the result remains valid for < 6 < ir. □ 



4. ClEBSCH-GORDAN coefficients for HYPERBOLIC BASIS VECTORS OF Su(l, 1) 

In this section we consider the tensor product of a positive and a negative discrete series repre- 
sentation. We diagonalize a certain self-adjoint element of su(l, 1) using (doubly infinite) Jacobi 
operators. We also give generalized eigenvectors, which can be considered as hyperbolic basis vec- 
tors. Using the summation formula from the previous section, we show that the Clebsch-Gordan 
coefficients for the eigenvectors are continuous Hahn functions. We find the corresponding integral 
transform pair by formal computations. In order to give a rigorous proof for the continuous Hahn 
integral transform, we realize the generators of su(l, 1) in the discrete series as difference operators 
acting on polynomials. Using these realizations, the Casimir element in the tensor product is real- 
ized as a difference operator. Spectral analysis of this difference operator is carried out in section 

ini 



4.1. The Lie algebra su(l, 1). The Lie algebra su(l, 1) is generated by the elements H, B and 
C, satisfying the commutation relations 

[H, B] = 2B, [H, C] = -2C, [B, C] = H. (4.1) 

There is a *-structure defined by H* = H and B* = —C. The center of ^(su(l, 1)) is generated 
by the Casimir element il, which is given by 

n = -^{H^ + 2H + 4CB) = -^{H^ -2H + ABC). (4.2) 

There are four classes of irreducible unitary representations of 5u(l, 1), see ^3 §6.4]: 
The positive discrete series representations vr^ are representations labelled by A; > 0. The 
representation space is ^^(Z>o) with orthonormal basis {en}„gz>o- The action is given by 

T^t{H) e„ = 2{k + n) e„. 



7r+ (5) e„ = ^/{n + l){2k + n) e„+i , 
7r^(C)e„= - y/n(2k + n - 1) Cn-i, 
TT'li^l) e„ = k{l - k) e„. 
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The negative discrete series representations ttj^ are labelled by > 0. The representation space 
is £^(Z>o) with orthonormal basis {e„}nez>o- The action is given by 

■K~{H)en= -2{k + n)en, 



■K^{B)en= - \/n{2k + n - 1) e„_i, 

(4.4) 

vr^ (C) e„ = v^(n + l)(2/c + n) e„+i, 

7r^(ri) e„ = A;(l - k) en- 

The principal series representations vr''''^ are labelled by e G [0, 1) and /? > 0, where (p, e) 7^ (0, ^). 
The representation space is £^(Z) with orthonormal basis {enjnez- The action is given by 

^P^'{H) e„ = 2(e + n)e„, 



Tr'''%B) e„ = -y/ (n + e + ^ - + e + ^ + ip) e„+i, 

^ 1 (4.5) 

ttP^^C) e„ = - \/ (n + e - - - zp)(n + e - - + «/o) e^-i, 

7r^'^(17)e„ = (p2 + i)e„. 



For (p, e) = (0, |) the representation vr'^'s splits into a direct sum of a positive and a negative 
discrete series representation: vr'^'a = vr^2©^i/2' '^^^ representation space splits into two invariant 
subspaces: {e„ | n < 0} © {e^ | f^ > 0}. 

The complementary series representations vr^''' are labelled by e and A, where e G [0, ^) and 
A G (— |, — e) or e G (^) 1) and A G (— ^, e — 1). The representation space is £^{7j) with orthonormal 
basis {en}nez- The action is given by 



Tr^''{H) en = 2{e + n) en, 

ir^'%B)en = + e + 1 + A)(n + e - A) e„+i, 



^^■"(C) e„ = - V(n + e + A)(n + e - A - 1) e„_i, 
7r^'^(0)e„= -A(l + A)e„. 



(4.6) 



Note that if we formally write A = — 2 + the actions in the principal series and in the comple- 
mentary series are the same. 

We remark that the operators ()4.3|) - H4.6|) are unbounded, with domain the set of finite linear com- 
binations of the basis vectors. The representations are *-representations in the sense of Schmiidgen 
[H Ch.8]. 

The decomposition of the tensor product of a positive and a negative discrete series representation 
of su(l, 1) is determined in full generality in Thm.2.2]. 
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Theorem 4.1. For ki < k2 the decomposition of the tensor product of positive and negative discrete 
series representations o/su(l,l) is 



k2 



TT 



k2 



/ TT^'^dp © TT 





oo 



X,e 



ki + k2 < 





oo 



TT 



k2 



TTP^^dp ( 



e 



TT 



ko < --, 



k2-ki-j-j>0 



where e = ki — k2 + L, L is the unique integer such that e G [0,1), and A = —ki 
intertwiner J is given by 



^(Cni O fina) = (-1)"^ / S'„(y; ni - 722) e„,_„2_L d/i2 (y; m - 722), 

Jr 

where n = min{ni,n2}, Sn{y',p) is an orthonormal continuous dual Hahn polynomial, 

Sn{y; ki - k2 + ^,ki + k2 - l,k2 - ki - p + i), p < 0, 



fco . The 



(4.7) 



Sn{y;p) 



2 I'"! I '^'Z ^5^1 



^Sniy;k2 -ki + ^,ki + k2 
and dp,{y;p) is the corresponding orthogonality measure 

dp,{yp) - /^'"(^'^i -k2 + ^,ki + k2- ^,k2- ki-p + p< 0, 
\^dp{y;k2 - ki + ^,ki + k2 - \,ki - k2 + p+ p>0. 

The inversion of ()4.7p can be given exphcitly, e.g. for an element 



/ ® Gr-L 



f{Z)dx 



in the representation space of the direct integral representation, we have 

'CO p „ 

^^(-l)^'-'^ / Sp{y-r)f{y)dp.^{y;r) 

00 r „ 

Y^i-iy / Sp{y;r)f{y)dpky; 



J*if<g)er-L) 



;r) 



Ip=o 



r < 0, 
r > 0. 



(4.8) 



For the discrete components in Theorem 14.11 we can replace / by a Dirac delta function at the 
appropriate points of the discrete mass of d/i(-; r). We remark that for ki = k2 < 1/4, the occurrence 
of a complementary series representation in the tensor product was discovered by Neretin [20]. This 
phenomenon was investigated from the viewpoint of operator theory in [2]. 

In the following subsection we assume that discrete terms do not occur in the tensor product 
decomposition. From the calculations it is clear how to extend the results to the general case. At 
the end of section [21 we briefly discuss the results for the discrete terms in the decomposition. 

In the Lie algebra su(l, 1) three types of elements can be distinguished: the elliptic, the parabolic 
and the hyperbolic elements. These are related to the three conjugacy classes of the group SU (1,1). 
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A basis on which an eUiptic element acts diagonally is called an elliptic basis, and similarly for the 
parabolic and hyperbolic elements. The basisvectors Cn in (|4.3j) - (|4.6)) are elliptic basisvectors. 
We consider self-adjoint elements of the form 

-aH + B - C e 5u{l,l), (aGM), 

in the tensor product of a positive and a negative discrete series representation. For \a\ = 1 this is 
a parabolic element, for \a\ < 1 it is hyperbolic and for \a\ > 1 it is elliptic. For the elliptic and the 
parabolic case we refer to ^Hl, respectively We consider the case \a\ < 1. 

4.2. Hyperbolic basisvectors. We consider a self-adjoint element X,^ in su(l, 1), given by 

= -coscj) H + B - C, < < vr. 

The action of in the discrete series can be identified with the three-term recurrence relation for 
the Meixner-Pollaczek polynomials (|2.Hj) . cf. 15, Prop. 3.1]. 

Proposition 4.2. The operators Q^, defined by 

e± : f{Z>o) L2(M,ti;W(x;(/))(ix) 

are unitary and intertwine 7r^(X(^) with M {ziz2x siiKp) . 

Here M denotes the multiplication operator, i.e. M{f)g{x) = f{x)g{x). 
Proposition 14.21 states that 

oo 

v^{x) = ^Pi'\x;^)en, 

n=0 

are generalized eigenvectors of Tr^{X^) for eigenvalue ib2xsin(/). These eigenvectors can be consid- 
ered as hyperbolic basis vectors. 

The action of X^ in the principal unitary series can be identified with the recurrence relation 
for the Meixner-Pollaczek functions (|2.()j) . Then the spectral decomposition of the corresponding 
doubly infinite Jacobi operator gives the following. 

Proposition 4.3. The operator Q^'^ defined by 

QP'^ ■.f(Z)^n{-^ + ip,e,7r -(/)), 
e„H^ funi-,-l + ip,e,TT - 

is unitary and intertwines 7rP'^{X(f)) with M(2xsm(j)), and extends to a unitary equivalence. 
From ProDostion 14.31 we obtain that 

f'"p,e{x)\ ^ ^ /unix;-^ + ip,e,7r - 

is a generalized eigenvector of '7tP'^{X^) for eigenvalue 2xsin0. 

Next we consider the action of in the tensor product. Recall that in the tensor product we 
need the coproduct A, defined by A{Y) = 1 <^Y -\-Y f^i 1 for Y £ su(l, 1). Then from Proposition 
14.21 we find the following. 

Proposition 4.4. The operator T defined by 

T : i\Z>o) (E) i\Z>o) ^ L'^{R^,w^^^\xi;cj))w^''^\x2;(p)dxidx2), 

en,^en,^Pi^'Hxi;(t>)Pi''H^2;(t>), 
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is unitary and intertwines tt^^ ^ vr^,^ (A(X0)) with M(2(xi — X2) sin (/>) . 

In terms of the generalized eigenvectors and v~ , we find from Proposition 14.41 that 

00 

v+{xi)(g)v-{x2)= Yl Pi^,'\xi;(f>)Pil'Hx2;4>)en,Ci)en„ 

ni ,112=0 

is a generahzed eigenvector of vr^^ ^ 7r^^(A(X<^)) for eigenvalue 2(xi — X2) sine/). 

To determine the action of T on the representation space of the direct integral representation 
J® TT^'^d/o, we need to find the operator T, such that T = T o J. Here J is the intertwiner defined 
in Theorem 14.11 For appropriate functions gi and (72 we define an operator by 

00 00 

tg : l2(o,cx)) ^ / f{Z)dx^ / n{-- + ip,e,TT -(l))dp, 





Jo ^'\92{p)) \K{t;-l + ip,e,TT-(l))J 

From Proposition 14.31 we see that Tg intertwines ■Kp'^(Xfp)dp with M (^2t sin (fj . The functions 
gi and g2 for which T = Tg o J are the Clebsch-Gordan coefficients for the hyperbolic bases. To 
determine the Clebsch-Gordan coefficients we use the summation formula in Theorem 13.11 Define 
the continuous Hahn function by 

iPp{x]t) =ipp{x]t,ki,k2,cl}) 



e 



^ fk2-ix,k2-h + ^ + ip,k2-ki + ^-ip \ (4.9) 



\r{ki+ix + it)\^'^ 2k2,k2-ki+it + l 

Theorem 4.5. Let 

^ 9i(.p)Y ^ f'Pp{x2; xi-X2)\* fm{p) 
^92{p)J \^*p{x2;xi-X2)J \ m{p) 
where ^Pp{x2; x\ — X2) = ^p(x2\ x\ — X2, k\^ k2, (p) and m{p) is given by 



m{p) =(-i) 



i (2 sin 0)-2fei-ie(^2-^^i)(20-^) y{1 + i{x2 - xi) + ip)T{\ + i{x2 - xi) - ip) 
^ T{k2-ki + i{x2-xi) + l) 



/ r(2fci) 
V r(2A^2) 

then we have T = To- o J. 



T{ki + k2-\+ ip)T{k2 -ki + \ + ip) 



T{2ip) 



Proof. To show that T = TgO J, we use the summation formula of Theorem l3.1l with the orthogonal 
polynomials written in orthonormal form. We multiply by a continuous dual Hahn polynomial of 
degree n2 with the same parameters as in Theorem 13.11 with p = rii — n2 > 0. Then integrating 
against the corresponding orthogonality measure gives an equality with the following structure 

poo 

Pi^)(xi;0)Pi^2)(x2;0) = / 5„,(p)(3F2 2F1+ZF2 2Fi)dp. 

Jo 

The 2-^1-functions are the Meixner-Pollaczek functions as defined by (|2.5() . From Proposition 14.21 
we see that the left hand side is equal to T(e„j en2)ixi, 3:2 )• So from Theorem 14. 11 with ni > n2, 
and Proposition 14.31 it follows that the right hand side must be equal to 



/ Sn2{p)g*{p)Q'''^{en^-n2-L){xi - X2)d^l^ (p), 

Jo 
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where g is a vector containing the Clebsch-Gordan coefficients for the hyperbohc bases. This gives 
the desired result. For m — n2 < the theorem fohows after using (|.S.H) . □ 

Remark 4.6. The exphcit expressions of the Clebsch-Gordan coefficients as 3i<2-series can also be 
found in Mukunda and Radhakrishnan |19| . The method used in is completely different from 
the method used here. 



In terms of the generalized eigenvectors, Theorem 14.51 states 

'(Pp{x2;xi - X2)Y f^ip) 



j{v^{xi)(g)V {X2)) 







mi 



Vp^eixi - X2) 



{p)j xylA^i -X2) 



dp. 



4.3. The continuous Hahn integral transform. Since the continuous Hahn functions occur as 
Clebsch-Gordan coefficients for hyperbolic bases, they should satisfy (generalized) orthogonality 
relations. We find these relations by formal computations with the generalized eigenvectors. 

For an element / G £^(Z>o) ® £^(Z>o) we have the transform pair 

' {'^f ){xi,X2) = (^V~{X2)), 



f 



{Tf){xi,X2) v~^{xi)(E)v (X2) w^''^\xi;(l))w^''^\x2;(t>)dxidx2- 



Similarly for / G ^^(Z) we have the transform pair 



(e^'V)(x) 



Vp,eix) 



G 



f = ^ I (0^'^/)(^)* 




wo{x)dx. 





Denoting the intertwiner J in Theorem I4.1l bv J = / Jpdp, we find from Theorem 14.51 



(Tr/)(xi,X2) 



iPp{x2;xi - X2) 
\^*p{x2; xi - X2) 



m{p) 
m{p) 



[eP^'{Jpf)){xi-X2)dp. 



We want to invert this formula. From (|4.1UI) and Theorem 14.51 we find formally 



Jpf 



{Tf){xi,X2)w^^^\xvA)w^^^\x2-A) 





Vp,e{xi - X2) 

Mp)J K'^*p,sixi - X2) 



(Ppix2;xi - X2)\ fm{p) 
^(p*p{x2;xi - X2)J \ 

We substitute xi x + 1, X2 ^ x, then (|4.11l) with / replaced by Jpf gives 

1 -wlit) 



dxidx2- 



wo{t) 



1 



Wlit) 

27r / {Tf){x + t,x) ("^^P^ 
Jr 



We denote 



(©"''(V))W 



27r 

Wo{t) 



m{p) 
m(p) 



1 -wl{t) 
-wi{t) 1 



sip) 



(4.10) 



(4.11) 
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and {J^g){x) = {Tf){x+t, x), then we have the following integral transform pair with the continuous 
Hahn functions kernel 



(•^g)(^) 



27r 



1 



/ ipp{x;t)\ 



1 / 



(^g)(x) ( '^pj^'^M w^^'\x + t;(P)w^''^\x;cl))dx. 
\ipp{x;t) 



In section |21 we give a rigorous proof for this integral transform pair using spectral analysis of 
a difference operator for which the continuous Hahn functions are eigenfunctions. In the next 
subsection we obtain the difference operator from the action of the Casimir element in the tensor 
product. 

4.4. A realization of the discrete series representations. The following lemma is based on 
the fact that s[(2,C) is semi-simple, so [5[(2, C),sl(2, C)] =sl(2,C). 

Lemma 4.7. 

B = ^[H,X^] + ^X^ + ^cos(^H, C = ^[H,X^] - ^X^ -^cos^H. 
Proof. This follows from the definition of X^p and the commutation relations (|4.1|) . □ 



This lemma shows that to find the action of the generators H, B and C on the Meixner-Pollaczek 
polynomials, it is enough to find the action of H, since the action of is known. The action of 
H follows from the difference equation (|2.4|) for the Meixner-Pollaczek polynomials. 

Proposition 4.8. The operator intertwines the actions of the generators H , B, C in the 
positive discrete series, with the following difference operators: 



e+vr+(S) 



e+vr+(C) 



Ml -^(k-ix)]Ti + M (2^x 
ismq) J \ sm(p 

— -ik -ix)]Ti + M[ 

2i sin I \ sin < 



M 



-i4> 



M 



+ M 



«sin( 
2i sin ( 



-{k + ix) r_ 



-{k + ix) r_ 



0+ 



M 



1 



2i sin I 



ix) ]Ti + M 



x 



smc 



+ M 



1 



2i sin ( 



-{k + ix) T_ 



where T denotes the shift operator: Taf{x) = f{x + a). For the negative discrete series, Q 
intertwines the actions of H , B, C , with the following difference operators: 



e-n,{B) 

e-vr-(c) 



M 



M 



M 



J-4> \ f cos 6 \ ( e"*"^ 

-(k -ix)\Ti + M[ -2 -X + M -{k + ix) \ T_ 

i sin 1 \ sin j \i sin 



1 



2i sin ( 



{k -ix)]Ti + M 



sm ( 



+ M 



1 



2i sin ( 



{k -ix)]Ti + M 



sin( 



+ M 



2i sin I 



-{k + ix) T^i 



e-. 



2i sin I 



-{k + ix) r_ 



G" 
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Proof. We find the action of H from the difference equation (|2.4)1 for the Meixner-Pollaczek poly- 
nomials; 

e+^+(F) en = e+i2n + 2k)en = {2n + 2k)Plt\x;c^) 

= -rC- [k - ix)Pjt^ {x + + 2x^Pi'=) (x; 0) - .^(fc + ix)Pj,''^ {x - </>). 
I sm <p sm (p I sm (p 

The action of is given in Proposition ^2 ^^''^t i-^<p) ^" ~ 2xsin(/) Pn\x; cf)). Then Lemma 14.71 
proves the proposition for the positive discrete series. 

We find the action in the negative discrete series in the same way, or we use the Lie-algebra 
isomorphism "i?, given by 

^{H) = -H, -diB) = C, ^{C) = B. 

Then TT^{^{Y)) = tt^{Y) for Y G 5u(l, 1). 

A straightforward calculation shows that these operators indeed satisfy the su(l, 1) commutation 
relations. □ 

Remark 4.9. To simplify notations we denote 0+7r^"(0+)* by vr^, and similarly for vr". 

In the same way as in Proposition 14.81 it can be shown that 0'''^ intertwines the actions of H, 
B and C in the principal unitary series with 2x2 diagonal matrices with difference operators as 
elements. This is done by finding a difference equation for the Meixner-Pollaczek functions u„ and 

, using contiguous relations for 2i^i-series. We do not need these realizations here, so we will not 
work this out. 

To express A{fl) in terms of H, B and C, the coproduct A is extended to Z//(su(l,l)) as an 
algebra homomorphism. Then from the definition of the Casimir element (|4.2() we find 

A{n) = i(g)n + n(g)i-^H^H-{C0B + B0C). (4.12) 

Using this expression and Proposition 14.81 we find the following. 
Proposition 4.10. In the realizations of Proposition we have 

Xl=X+t, X2=X 

m( - e-^''^{ki + i{t + x)) {k2 + ix))r_i + m(A:i(1 - ki) + A;2(l - fes) - 2{x + 
+m( - e2^<^(A;i - i{t + x)) {ki - ix)^Ti, 
where the shift operator T acts with respect to x. 

Proof. Let Fi{x) and F2{x) be polynomials in x, and let /(x, t) = Fi{x + t)F2{x), then a large but 
straightforward computation yields 



vr 

e 



+ ® 7r^^(A(f]))/(x,t) =[ki{l - ki) + k2{l - k2) - 2{x + t)x]f{x,t) 

{ki +i{t + X)) {k2 +ix)f{x-i,t) 

e'^'^{ki-i{t + x)){k2-ix)f{x + i,t). 

□ 
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Remark 4.11. The action of in the tensor product can also be found from 
7r+{H) = M{2ix), TT^{H) = M{-2ix), 

Tr+{B) = M{k - ix)T„ 7r-{B) = M (^e-^"^{k + ix)) T_i, 

TT+{C) = M{k + ix)T_i, TT~{C) = M {e'''^{k - ix)) T^. 

These reahzations are equivalent to the realizations given in Proposition 14.81 

In the next section we show that the continuous Hahn functions (pp{x; t, ki,k2, (j)) are eigenfunc- 
tions of the difference operator of Proposition I4.1U1 and we work out the corresponding integral 
transform. 



5. The continuous Hahn integral transform 

In this section we study a second order difference operator. This difference operator is obtained 
from the action of the Casimir operator on hyperbolic basis vectors in the tensor product of a 
positive and a negative discrete series representation of su(l,l), see section [4.21 The spectral 
analysis of this operator, leads to an integral transform pair with a certain type of 3i<2-series as a 
kernel. We call these 3i<2-series continuous Hahn functions, because of their similarity to continuous 
(dual) Hahn polynomials. The method we use is based on asymptotics, and is essentially the same 
method as used by Gotze [7] and Braaksma and Meulenbeld |^ for the Jacobi function transform 
by approximating with the Fourier transform. 

5.1. The difference operator A and the Wronskian. For ki, A;2 > 0, t G M and < (/> < vr the 

weight function 'w{x) is defined by 

w{x) = ^e(^^'+*)(20-7r)p(^^ ^ ^ ix)T{ki -it- ix)T{k2 + ix)T{k2 - ix). (5.1) 
zvr 

The difference operator A is defined by 

A : g{x) I— > a-^.{x)g{x + i) + P{x)g{x) + a-{x)g{x — i), 

where 

a±{x) = -e^^'^{k2 T ix){ki ^ i{t + x)), 

I3{x) =ki{l- ki) + /C2(l - k2) - 2{t + x)x. 

Initially A is defined for those g{x) £ L^(M, w{x)dx) that have an analytic continuation to the strip 

Se = {zeC : |9(z)| < 1 + e, e > 0} . 

The difference operator A corresponds to the action of the Casimir operator in the tensor product of 
a positive and a negative discrete series representation on hyperbolic basis vectors, see Proposition 

EM 

Remark 5.1. Observe that the functions e~^^'^'^~'^^pn{x; ki + it, k2, ki — it, k2), where pn is a contin- 
uous Hahn polynomial in the notation of jl3j . form an orthogonal basis for L-^(M, w{x)dx), but they 
are not eigenfunctions of A. Also, the functions e~'^'^^pn{x; ki + it, k2, ki — it, k2) are eigenfunctions 
of A, but they are not elements of Lp'{K,w{x)dx). 

We define 

pN 

{f,g)M,N= f{x)g*{x)w{x)dx. 

J-M 

Then limN^M^ooif, g) M,N is the inner product on L'^(R,w{x)dx), so {f,g)M,N is a truncated inner 
product. 
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Definition 5.2. For functions f and g analytic in Se, the Wronskian [f,g] is defined by 

ry+i 

[S,9\{y)= / {f{x)g*{x-i)- f{x-i)g*{x)}a-{x)w{x)dx. 
Proposition 5.3. Let f and g be analytic in S^, then 

{^f,9)N,M - {fAg)N,M = [f,9]{N) - [f,g]{-M). 

Proof. Observe that a'^ = a~, a±{x=fi)w{x=fi) = a'^{x)w{x) and /3*{x) = f3{x). Furthermore for 
X G M we have g*{x it = g{x ^ i). This gives for the Wronskian 

ry+i 

[/, a] (y) = / {f{x)g* {x -i) - f{x- i)g* {x)} Oi- {x)w{x)dx 
•'y 

y+i ny+i 



ry+i 

f{x)g* {x — i)a*_^{x)w{x)dx — / f{x — i)g*{x)a-{x)w{x)dx 

Jy 

ry+i ry 
= / f{x)g*{x — i)a-\-{x — i)w{x — i)dx — l f{x)g* {x + i)a-{x + i)w{x + i)dx. 

Jy Jy-i 

For / and g analytic in S^, we find 

/•AT 

I {Kf){x)g* {x)w{x)dx = / [a+(x)/(a; + i) + P{x)f{x) + a^{x)f{x — i)\ g*{x)w{x)dx 

J-M J-M 

/N+i j-N 
a+{x — i)f{x)g* {x — i)w{x — i)dx + / j3{x)f{x)g*{x)w{x)dx 
-M+i J-M 

/N-i 
a-{x + i)f{x)g*{x + i)w{x + i)dx. 
-M-i 

We choose a different path of integration 

/N-i I'-M i-N pN-i 

= / + / +/ 

-M-i J-M-i J-M JN 

and similarly for Then we find 

/N 
{Af){x)g*{x)w{x)dx = 
-M 

/-M pN 
a- {x + i)f{x)g* {x + i)'w{x + i)dx — / a_ {x + i)f{x)g* {x + i)w{x + i)dx 

-M-i JN-i 

j-N-\-i i—M-\-i 

+ I a+{x — i)f{x)g* {x — i)w{x — i)dx — / a+{x — i)f{x)g* {x — i)w{x — i)dx 

JN J-M 
r-N 

+ / /(^) [o'-l^^ + 'i)g*{^ + i)w{x + i) + P{x)g* {x)w{x) + a_|_(x — i)g*{x — i)w{x — i)\ dx. 



-M 

N 



The last integral J_j^ equals 

^N r-N 

f{x) \a*_{x)g* {x + i) + (3* {x)g* [x) + Q*j^{x)g* [x — i)\w{x)dx = / f{x){A.g)*{x)w{x)dx, 

-M J-M 

and in the other four integrals we recognize [f,g\{N) — [f,g\{—M). □ 

Our first goal is to show that A is a symmetric operator on a domain which will be specified, 
so we are interested in the limit of the Wronskian [f,g\{y) for y — > ztoo. The following lemma is 
useful in determining these limits. 
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Lemma 5.4. Let ki,k2 > 1, x £ M, and — 1 < y < 1, then the weight function w{x + iy) has the 
following asymptotic behaviour 



w{x + iy) 



Proof. From Stirling's asymptotic formula |2H (8.16)] we find for u > and u G M 

r(n + iv) = \/2^|u|"+™-5e-("+™) e(i«-'')a=-cta'iW") + O (^-^ , v ±oo. 



We use 



to find for v ±00 



V u 
arctan — h arctan — 
u V 




So we liave 



[lu — V) arctan — = [lu — v) ± + C - 

u \ 2 yy \v 



Applying this formula to the four T-functions in ()5.1j) gives the asymptotic behaviour of the weight 
function w{x + iy). □ 

In general, if for some e > 



then the moment problem for the measure dfi is determinate, see e.g. [T2| and references therein. 
Using this criterion with < e < min{4(/>, 4(7r — 4>)}, we find from Lemma 15.41 that the moment 
problem for the measure w{x)dx is determinate. In particular this shows that the polynomials are 
dense in Lp'{K,w{x)dx). 

Let 2? be the space of polynomials on M, then 2? is a dense subspace of L?'{^,w{x)dx). Since 

a_(x + zy) = e-2^V(^l + C'(^)), x ^ ±00, (5.2) 

it follows from Definition 15.21 and Lemma 15.41 that lim7v-+±oo[/) 5](-^) = for /, g polynomials. 
Hence by Proposition 15.31 we find 

Proposition 5.5. The operator (A, P) is a densely defined symmetric operator on L'^(K,w{x)dx). 

Remark 5.6. The operator (A, D) is also densely defined and symmetric on the space spanned by 
g-x(2</>-7r)^^^^^^ where pn is a polynomial, cf. Remark 15.11 

5.2. Eigenfunctions of A. We determine eigenfunctions of A, using contiguous relations for 3F2- 
functions. First note that for a monic polynomial of degree n, Pn{x) = x" + . . . , we have 

{Kpn){x) = [a+(x) + j3{x) + a_(x)] x" + lower order terms. 

Since a+(x) + /3(x) + q;_(x) is a polynomial of degree 2, A raises the degree of a polynomial by 2. 
Therefore A cannot have polynomial eigenfunctions. 
Let p{x) be the i-periodic function 

p{x) = —e^^ sin(7r(/ci - it - ix)), (5.3) 
vr 
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and let ^p{x) = (pp{x; t, ki, k2, (p) and ^p{x) = $p(x; t, ki, k2, (p) denote the functions 

T{l-ki+it + ix) [k2-ix,k2-ki + \ + ip,k2-ki + \-ip . 

+ \ 2k2,k2 — ki + it + \ ' 

$ (x) =e ^ p(x)^ , ,o - 

' ^ ^T{ki+ix + it)T{^- ki+ix + ip) 



k2 - ki + \ + ip,^ - ki - k2 + ip,\ - it + ip 
1 + 2ip, ^ — ki + ix + ip 



X3i^2 " " r% " ;i . (5.5) 



Both 3F2-series are absolutely convergent for ^{ki + it + ix) > 0. Note that the expression for 
^Pp{x) is the same as 1)4. 9|) after applying Euler's reflection formula. 

Proposition 5.7. For ki > 1, the functions (pp{x) and^p{x) are eigenfunctions of A for eigenvalue 

Remark 5.8. (i) Observe that due to the i-periodic function (Pp{x) is an entire function. Denote 
<^p(x) = ipp{x)/p{x), then p{x) cancels the poles of (pp{x). There are more choices of z-periodic 
functions that cancel the poles of (pp{x). One of the reasons for this particular choice, is that it 
appears in the Lie-algebraic interpretation of the function ipp{x), see Theorem 14.51 We come back 
to the choice of the i-periodic function in Remark 15.151 

(ii) Observe that (p*p{x) is obtained from ipp{x) by the substitutions {x,t,(j)) {—x,—t,7r — (p). 
Since the difference operator A and the weight function w{x) are invariant under these substitutions, 
it follows from Proposition 15.71 that, for ki > 1, 95* (x) is also an eigenfunction of A for eigenvalue 
(/9^ + 5). A similar argument shows that ^p{x) is an eigenfunction of A for eigenvalue (p^ + 5). 
Obviously $_p(x) and $* ^(x) are also eigenfunctions of A for eigenvalue (p^ + j). 

Proof. Combining the contiguous relations T, (3. 7.9), (3. 7. 10), (3. 7. 13)], gives 

{d - a){e - a) [F{a-) - F] + a{a + b + c - d - e + I) [F{a+) - F] = -bcF, 

— ^(tr^O- -<-)--<°'.:;'"^^ 

From this relation we find that 

-2(i,x r(l - ki + it + ix) ^ fk2- ix, k2 - ki + \ + ip,k2 - ki + \ - ip 
^ T{ki +ix + it) ^ 2k2,k2- ki+it+l 

is an eigenfunction of A for eigenvalue p^ + \. And then, since p{x) is i-periodic, ipp{x) is also an 
eigenfunction for eigenvalue p^ + \ . Since v'p(x) must be analytic in 5^, the condition fci > 1 is 
needed for absolute convergence of the 3F2-series at the point x + i. 
Denote 

^/ x ^/a, 6±l,c±l 
F±{a^) = 3i^2 ' ' , , ;1 



d±l,e±l 

From contiguous relations 1, (3.7.9), (3.7.10), (3.7.13)] we find 

{d - l)(e - l)F-(a+) - (6 - l)(c -l)F - {a - l){d + e - a - b - c)F 
bc{d — a)(e — a) 



+ 



de 



-F+(a-) - {d - a){e - a)F 



0. 
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From this we see that 



2<t>x^f^^ r(l - fc2 + ix)T{l + 2ip)T{l -ki + ix + it) 

r(i + it + ip)r{ki + l + ip + ix)r{^ -ki+ix + ip) 



l-it + ip,l-k2 + ix,k2 + ix \ 
X 3i^2 , 1 . .3 , . . ; 1 > (5-6) 

\Ki + 2+iX + ip,2—ki+ip + lX I 

is another eigenfunction of A with eigenvalue + |. The 3F2 series converges absolutely if + 
ip + it) > 0, so absolute convergence does not depend on ki. Using ^ Cor. 3. 3. 5] this can be written 
as 1)5. 5p . and for this expression the condition A;i > 1 is needed. □ 

The function ipp{x) can be expanded in terms of ^p{x) and <I>_p(x). 

Proposition 5.9. 

<^p(z) = c{p)^p{x) + c(-/))$_p(x), 

where 

T{2k2)T{k2 -ki + it + l)T{-2ip) 



T{ki + k2 - ^ - «p)r(i +it- ip)T{k2 - ki + \ - ip) 
Proof. This follows from 2, p. 15(2)] 

/a,6,c \ r(l - a)r((i)r(e)r(c - fe) fb,h-d+l,h-e + l _ 

^^\d,e ' ) ~T{d-b)T{e-b)T{l + b-a)T{c)^ l + b-c,l + h-a ' 
+ idem(6; c). 

Here idem(6; c) after an expression means that the expression is repeated with h and c interchanged. 

□ 

In the next subsection we consider the Wronskians [ipp,(p(j\{y) and [99*, for y — > ±00, so 

we need the asymptotic behaviour of i^p. We find this from Proposition 15.91 and the asymptotic 
behaviour of ^p. 

Lemma 5.10. Let ki > 1, p ^ C and — 1 < y < 1. For x — > ±00 

^p{x + iy) = p{x + iy)e-2'^(^'+^^)(ix)5-^i-'=2-.p |i + ^{A{p) + yB{p)) + O(^) } , 

+ iy) =p*{x + iy)e-2*(^+^^)(-ix)5-^'^-'=2+^^ |l + ^^(^ " yW)) + ^(^) } ' 

where 

1 3 

A{p) =2it{l - 2ki) + {ki -k2 - --ip){--ki-k2 + ip) 

(^2 - ^1 + f + - ki - k2+ ip){l - it + ip) 

\+ip 

B{p) =2ki + 2/c2 - 1 + 2ip. 
Proof. This follows from (|5.5|) and the asymptotic formula for the ratio of two T-functions 21 , §4.5] 

^|^ = z'^-^(l + ^(a-6)(a + 5-l) + 0(l)), |z| ^ 00, |arg(z)|<7r. (5.7) 

The first part of the expression for A{p) is obtained from 

(ai - 6i)(ai + hi-l) + (02 - &2)(a2 + ^2 - 1), 
the second part comes from the second term in the hypergeometric series. □ 
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The asymptotic behaviour of the i-periodic function p{x) is also needed; 

' gj7r(fci+2y) 



p{x + iy) 



in{ki+2y) -inki 
e .gvr(2a;+i) _ f ^-wt 



2m 



27ri 



p*{x + iy) 



2m 



-nt 



-in(ki —2y) 

2m ' 



,7r(2z+t) 



,7r(2x+t) 



2m 



-iirki 



+ 0{1) 



-nt 



2m 

^-iTT{ki-2y) 



2m 



oo, 



-oo, 



oo, 



^inki 

. 27ri 



-oo. 



5.3. Continuous spectrum. We determine the spectrum of the difference operator A. In this 
subsection we consider the case where the spectrum only consists of a continuous part. 
Since 



\{ix) 



-k\—k2—ip\2 



|^|l-2fci-2fc2+2S(p)g7r5R(p)^ X > 0, 
|2,|l-2fei-2fc2+2S(p)g-7rSR(p)^ X < 0, 



we find from Proposition I5.1U1 

\^p{x)\^w{x)=0{\x\^'^^p'^-'^), X 



iboo. 



(5.8) 



So ^p{x) is an element of L'^{M.,w{x)dx) for '^{p) < 0. This shows that it is possible to give 
eigenfunctions of A for complex eigenvalues. We only consider eigenfunctions which are even in p, 
and in that case all eigenvalues of A are real. 

First we consider the continuous spectrum of A. We show that [^,oo) is contained in the 
continuous spectrum. Assume that p is real and that the c-function in Proposition 15.91 does not 
have zeros, or, equivalently, assume that ki + k2 > \ and k2 — ki > — i. Since we only consider 
even functions in p, we may assume p > 0. We use Proposition 15.31 to calculate the truncated inner 
product of two eigenfunctions. This gives for ki > 1 and p ^ cr 



[iPp,ip^]iN)-[ipp,^^]i-M) 



p^ — 



(5.9) 



Multiplying both sides with an arbitrary function f{p) and integrating over p from to oo, gives 



f{p){fp,f<T)M,N dp 



f{p) :5 — ^5 dp. 



P^ — (T^ 



(5.10) 



The function f[p) must satisfy some conditions, which we shall determine later on. We take limits 
A'^, M — > oo on both sides. To determine the limits of the Wronskians, the following lemma is used. 



Lemma 5.11. Let ki,k2 > 1 and p, o" > 0. For for x ±00 



[<^p,^^]{x) = ±D^{p,a){p + a)\x 



i{a-p) 



where 



27r 
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Proof. From Lemma l5. 101 we find for < y < 1 and x ^ oo 
$p(x + iy)^>* (x + iy-i) - ^p{x + iy - i)^>* (x + iy) = 



2ix V X 



-4i0jy+4i7r2y-40a; 1^ I l-2fci -2k2 |p(x) ^ 6^5'^^''+°') | x| ^ ^ 1 _)_ ( 1 ' 



Using the asymptotic behaviour of p{x) and Lemma 15.41 we find the asymptotic behaviour of the 
integrand of the Wronskian. Note that this is independent of y. In a similar way we find the same 
asymptotic behaviour of the integrand for x — > — oo. Now the lemma follows from writing the 
Wronkian as 

l-x+i pi 

f{z)dz = i f{x + is)ds, 



and applying dominated convergence. □ 
Proposition 5.12. Let a > 0, and let f be a continuous function satisfying 

f ©(e-^V^'"^-^), p ^ oo, e > 0, 



m 

then 



(•oo 

lim 



POO 

/ fip){^P^ Va)N,N dp = WQ^{a)f{a), 
Jo 



where 



zvr 



T{k2 -ki + ^+ ia)T{ki + k2 - ^ + icr)T{^ + it + ia)T{^ - it + ia) 



T{2k2)T{k2 -ki+it + l)r(2icr) 



Proof. Let ki,k2 > 1. We use (|5.10j) to calculate lim.N-*co f{p){^p,^c7)N,N dp. From the c- 
function expansion, see Proposition 15.91 we obtain 

[ipp,ipa]{x) = c(ep)c(ecj)[$,p,$5^](x). 
^,^£{-1,1} 



Then ()5.9() and Lemma 15.111 give . for ^ cxd, 

— c(ep)c(^cr) D^{ep,^a) + D {ep,^a) 

ep — fa I 

From (|5.1fl|) we find 

POO 

lim / f{p){(Pp,'^a)N,N dp = 
N^oo Jq 

lim / f{p)\tl;i{p)cos{[p + a]\nN) + ip2{p)sm{[p + a]lnN) 
Jo 



+ MP) cos ([p - .1 1„ N) + V.4(P) """'""''"^> U, 

p-a 
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1 



p + (T 

—i 
p + a 
1 

p-a 



c{p)c{-a) {D+ip, -a) + D'ip, -a)) - ci-p)c{a) {D+{-p, a) + D-{-p, a)) 



c{p)c{-a) {D+ip, -a) + D'ip, -a)) + c(-p)c(a) {D+{-p, a) + D-{-p, a)) 



c{p)c{a) {D+{p, a) + D-{p, a)) - c{-p)c{-a) {D+{-p, -a) + D-{-p, -a)) 



c{p)c{a) {D+ip, a) + D-{p, a)) + c{-p)c{-a) {D+{-p, -a) + D-{-p, -a)) 



Writing out explicitly the terms between square brackets for tp^ gives, for p = a, 



,t(29i-7r) 



T{2k2)T{k2-ki+it + l)T{2ip) 



T{ki + k2 - ^ + ip)T{k2 -ki + ^ + ip) 



sin (7r(i + it + ip)) sin (7r(^ — it + ip)) 

|r(i -it + ip)|2 \ra + it + ip)\^ 



From Euler's reflection formula it follows that this is equal to zero. So ip^ has a removable singularity 
at the point p = a. 

From the Riemann-Lebesgue lemma, see e.g. j2R( §9.41], it follows that for ft/ji G L"'^(0,oo), 
i = 1,2, 3, the terms with ipi, i = 1,2, 3, vanish. This leaves us with a Dirichlet integral, for which 
we have the property (see e.g. j2Hl §9.7]) 



lim — 

t^oo vr 



' , , sin[t(x — v)] , , , 



x-y 



(5.11) 



for a continuous function g G L^(0, oo). This gives for a continuous function / that satisfies 
f^bf eL\0,oo), 



lim 



f{p){^p,^a)N,N dp = 'Kf{a)llJi{a) 



lgt(20-^) (-+t) + e"("+*))c((j)c((j) + (e-"("-*) + e"(""*))c(-a)c(-a)) } f{a) 



T{2k2)T{k2 -ki+it + l)r(2icj) 



T{k2 -ki + ^ + ia)T{ki + k2 - ^ + ia) 



sin (7r(i + it + ia)) sin (7r(i — it + ia)) 



+ 



|r(i -it + ia)|2 \T{l + it + ia 



27re 



t(2(^-7r) 



T{2k2)T{k2 -ki+it + l)T{2ia) 



T{k2 -ki + \+ ia)T{ki + k2-\ + icF)T{\ + it + i(T)T{\ - it + ia) 



--W^\a)f{a). 



In the last step Euler's reflection formula is used. The conditions ki,k2 > 1 can be removed by 
analytic continuation. Since 



0(1), a^O, 



we find that the proposition is valid for the conditions of / as stated. 



□ 



Next we consider the truncated inner product {^p*p, ^fa) m,n and the corresponding Wronskians. 
We need to find the analogues of Lemma 15.111 and Proposition 15.121 
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Lemma 5.13. Let ki > 1 and p,(J > 0. For x — > ±oo 

where 

?±f ^ _ _]_pt{2<l)-TT)^±^ni{2ki-2k2+ip+icr+2it) 



Proof. The proof is similar to the proof of Lemma 15.111 

Proposition 5.14. Let cr > 0, and let f be an even continuous function satisfying 

'C)(e-^Pp2fc2-i-e)^ p ^ oo, e > 0, 
0{p^), p^O, 6>0, 



□ 



fip) 



then 



where 



Um 



f{p){ip;,^.)N,Ndp = W,-\a)fia), 



W (a) =— '*(2</<-^) r(fci -k2+ it)T{^ -it- ia)r(l -it + ia) 
' 2^^ T{k2-ki-it + l)T{2k2f 

T{k2 -ki + \ + ia)T{ki + k2-\ + ia) 



T{2ia) 

Proof. The proof runs along the same lines as the proof of Proposition 15.121 therefore we leave out 
the details. 

As in the proof of Proposition 15.121 we find from Lemma 15.131 



lim 



lim 



fip){f*p,'^cr)N,Ndp = 

r 

f{p) I Mp) cos {[p + a] In N) + V2(/o) sin {[p + a] In N) 

sin([p-cr] IniV) 



+ V'3(/') cos {[p - a] InN) + ipiip)- 



p-a 



'dp, 



where 
^i(p) 

■02 (p) 
■03 (P) 
■04 (p) 



1 



p + a V 
i 

p + a V 

-1 
p-a 

—i 



c(p)c(a) {E+{p, a) - E-{p, a)) - c(-p)c(-a) {E+{-p, -a) - E-{-p, -a)) 



c{p)c{a){E+{p, a) - E^ip, a)) + c{-p)c{-a) {E+{-p, -a) - E~{-p, -a)) 



c{-p)c{a){E+i-p,a) - E~{-p,a)) - c{p)c{-a){E+{p, -a) - E-{p, -a)) 



c{-p)c{a) {E+{-p, a) - E'{-p, a)) + c(p)c(-a) {E+{p, -a) - E'ip, -a)) 



For p = a the term between the square brackets for is equal to zero, so "03 has a removable 
singularity at the point p = a. So, for ft/ji G L^(0,oo), i = 1,2,3, the terms with ipi, i = 1,2,3, 
vanish by the Riemann-Lebesgue lemma. This leaves us with a Dirichlet integral. Then, after 
applying 1)5. 11() . we find for 7-04 G L^{0, oo) 



lim 



f{p){f*p: fa)N,N dp = 7r'04(cr)/(cr). 

Writing out -04 explicitly gives the result. 



□ 
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Remark 5.15. In E,emark 15.81 we observed that the i-periodic function p{x) cancels the poles of 
(pp{x). Other obvious choices with the same property would be e^^'^^p{x), for A; G Z. However for 
/c 7^ 0, the method we used here to find an integral transform pair would fail, since the method 
depends on the use of the Riemann-Lebesgue lemma and the Dirichlet kernel, which can no longer 
be used in case A; 7^ 0. This can e.g. be seen from Lemma l5.111 where the terms in front of 
would contain a factor e^^'^^' . So this gives a heuristic argument for the choice 1)5. 3(1 of the i-periodic 
function. 



Let / be a continuous function satisfying. 



/(/>) = (""SC"^'"^' '^^^ (5.12) 



and let f be the vector 

We define, for x G M, an operator T by 

iJ'{)ix) = {ip,{x)J{p) + ^;{x)f{p))w^{p)dp. (5.13) 

To verify that this is a well-defined expression, we determine the behaviour of ^Pp{x) and Wo{p) for 
p — > 00 and p I 0. From Thomae's transformation TD, Cor. 3. 3. 6] we find 



And from 1)5. 7|) we obtain 



0(1), p^O. 



H^o(p) = (^r"^""^^' (5.14) 

Then we see that the integral in (|5.13l) converges absolutely for / satisfying (|5.12|) . 
For a continuous function g satisfying 

Jo(|x|i-'^i-'=2-£g2(w)x)^ x^oo, e>0, 

\0(Ni-^-'=-V2'^-), x^-oc, 6>0, ^^^ ^^ 

we define, for p > 0, an operator Q by 

(^ff)(p) = ^5(x)(^^j^])Mx)dx. (5.16) 

From the asymptotic behaviour of f*p{x) and ■w{x) for x ±00, see Lemmas 15.41 and f5 . 1 01 it follows 
that the integral in (|5.16|) converges absolutely. 

Proposition 5.16. If g = Ti, and g satisfies the conditions 1)5. 15() . then 

iGg)ip) = ( 1 W,{p)/W,{p)\ /7(^\ 

Proof. For a function g satisfying ()5.15|) we define operators Qi and Q2 by 

{Gi9){p) = I g{x)ip*p{x)w{x)dx, 



(5.17) 

{G2g){p) = / g{x)ipp{x)w{x)dx, 
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then we have 



\i g{x) = {J-f){x) satisfies the conditions (|5.15|) . then the integral 

(GigKa) = [ {Tf){x)^l{x)w{x)dx 

JR 

converges absolutely. So from (|5.1.Sj) we obtain 
iGig){cr) = lim / ipl{x 

N^ooJ_^ 



^p{x)f{p)W^{p)dp + / ^*{x)f{p)Wo{p)dp w{x)dx, 



and interchanging integration gives 



= lim / fip)WQ{p){ipp,(pa)N,N dp + lim / f{p)Wo{p){ip*ipa)N,N dp. 



N~*oo 



From (|5.12j) and (|5.14l) it follows that the functions /(p)VFo(p), f{p)Wo{p) satisfy the condi- 
tions for Propositions respectively. Applying the propositions gives {Qig){(T) = f{a) + 
f{a)Wo{a)/Wi{a). In the same way (^25')(o") can be calculated. So we find (^2<?)(o') = /(f) + 

We define an operator by 



(x) 



^^p{x)) \-Wo{p)/Wr{p) 1 
From Proposition 15. 16l we find {Q{Ti)^{p) = i{p). 



o{p)/W,{p)\ ff{p)\ Wojp) 



\fip)J 1 



(5.18) 



Wi{p) 



jdp. 



Remark 5.17. From Euler's reflection formula and the identity 2sinxsin?/ = cos(x — y) — cos (x + y) , 
we find 



1 



We define 



ippix) 



Woip) 


2 


T{\ + it + ip)T{\-it + ip) 


2 


Wi{p) 




T{ki 


-k2 + ^ + ip)T{k2 -ki + ^ + ip) 




x(2<I>--k) 




-it- 


ip)T{^ -it + ip)T{2k2)T{k2 -ki+it + l) 



r(A;i +ix + it)T{k2 - ix)T{ki + k2 - it)T{ki - k2 - it + 1) 
p f ^ — it + iPi — it — ip, ki — ix — it \ 
^ ^ \ ki — k2 — it + 1, ki + k2 — it ' / ' 



then from p, §3.8(1)] we obtain 

Wi{p) 

So the definition of ()5.18|) is equivalent to 



^p{x) 



\T{k2-ki + ^ + ip)\^ 



iri)ix) 



rp{x)Y (fip) 

\Mx)J \f{p) 



W2ip)dp, 
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where 



-t(20-7r) 



T{ki -k2 + l + ip)T{k2 -ki + \ + ip)T{ki + k2-\ + ip) 



T{2k2)T{k2-ki+it + l)T{2ip) 



2 



Note that W2{p)dp is the orthogonahty measure for the continuous dual Hahn polynomials. 

The function J^i exists for all functions f for which the integral (|5.18)) converges. We want to 
find a domain on which is injective and isometric. We look for a set S of functions for which 
J^S is a dense subspace of L'^{M,w{x)dx). Recall that the set of polynomials is a dense subspace 
of L'^{R,w{x)dx). 

Lemma 5.18. Let pi^\-; (j)) denote a Meixner-Pollazcek polynomial as defined by ()2.2|) . then 



(rf^)(-;0))(p)=q„(p) = (^j;;]), 

with Qn given by 

-e-*^ X 2fc2+n (_l)nr(2A;2) \(k2 - k^ + ^ + 



X 2F1 



n\ {k2 - ki+it+ l)n 
n + k2-ki + \ + ip,n + k2-ki + \-ip _ 1 



n + k2-ki+it + l ' 1 - e^'-'t' 



Proof. Let Qi and Q2 be as defined by ()5.17() . Since the Meixner-Pollaczek polynomial pn is real, 
we have Qipn = G2Pn- Writing out qn{p) = (GiPn^\-; (p)^ (p) explicitly, gives 

n! 2-K V 2A;2 / 



(ln{p) = e 



k2 + ix,k2 - ki + 1^ + ip,k2 - ki + y - ip 
X 3X<2 , , , ; 1 ax 

^ ' 2k2,k2 -ki-it + l ' ' 



^otl^ ml{2k2ym{k2-ki-it + l)m n{2k2y ' 
- [ e^(2'^~^)r(A:2 + + m)r(A:2 - + Odx. 



27r 



The inner integral can be evaluated by [221 (3.3 
27ri 



1 r^+^oo rfa) 

T{s)T{a-s)y~'ds=j:^^^, < < K(a), | arg(y)| < vr. 



with s = A;2 + + and a = 2k2 + m + l. Now the sum over / becomes a terminating 2-^1-series, 
which can be evaluated by the Chu-Vandermonde identity [fl Cor. 2. 2. 3] 

/ -n, 2k2 + m 

V -^^2 / I N — 1 m > n. 




Then reduces to a single sum, starting at m = n. Shifting the summation index gives the 

result. □ 

Proposition 5.19. For a continuous function g G L'^{M.,w{x)dx), we have J^{Qg) = g- 
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Proof. Let qn be as in Lemma f5.18l We show that (^qn)(a;) = p„ {x; 4>). From this the proposition 
follows, since the polynomials are dense in L'^{W,w{x)dx). 

Transforming the 2-^1-series of g„ in Lemma 15.181 bv 1, (2.3.12)] and using the asymptotic 
behaviour ^ 2.3.2(16)], we find 



From Stirling's formula it follows that |VFo(p)/Wi(/9)| = 0{e~'^P) for p 00. So by 1)5.14(1 and 
(|5.18() we see that J^qn exists. 
We calculate 



I{x) = / 'iljp{x)qn{p)W2{p)dp, 



then according to Remark 15.171 we have .Fqn = 1 + 1. Writing ipp{x) and qn{p) as a sum, and 
interchanging summation and integration, gives 

00 00 , 2i(t>\-l 



{ki — ix — it)r 



1=0 m=0 



U {n + k2 — ki — it + 1)1 ml {ki — k2 — it + l)m(^i + k2 — it). 



where 



Il,m =7r / -it + ip + 'm)T{- - it - ip + m) 

ZTT Jq 2 2 



T{ki -k2 + h+ ip)T{n + k2-ki + ^ + ip + l)T{ki + k2-k + ip) 



T{2ip) 



dp, 



(J — g-x{2<P~Tr) 



-i(j> 



\ _ Q-2i<f> 



2k2+n 



T{k2 -ki + it + l) 



T{ki +ix + it)T{k2 - ix)T{ki + /c2 + it)T{k2 - ki - it + n + l)T{ki - k2 - it + I) 
The integral Ii^m can be evaluated by jT| Thm.3.6.2]; 

r{k2 -ki-it + n + m + l + l)T{ki - k2 - it + m + l)T{ki + k2 - it + m) 



I, 



Lm 



T{ki +k2-it + n + m + l + 1) 
X r(n + / + l)r(2/c2 + I + n)T{2ki). 
Now the sum over m is a 2-?*'i-series which can be summed by Gauss's theorem; 



2F1 



ki — ix — it, k2 — ki — it + n + I + 1 \ T{ki + ix + it)T{ki + k2 — it + n + I + 1) 



1 



ki + k2-it + n + l + l 'V r(/c2 + ix + Z + n + l)r(2A;i) 

Then the sum over / becomes a 2^1-series, and after applying Euler's transformation we obtain 

x(2<^-.). (-e^<^)"-2- (-l)"r(2A:2 + n) 



I{x) =e 

X 2F1 

As in (|3.3|) we find from this 



1 - e-2*</')«a:+fc2 r{k2 + ix + n + l)r(/c2 - ix) 
k2 + ix,l — k2 + ix 1 



k2 + ix + n + l '1- e-2«<7^ 



(^qn)(x) =/(x)+/(x) 



(2A:2)n 



n! 



e ^2-1^1 



-n, k2 + ix 

2k2 



■,l-e-'^^)=p<i^Hx;, 



Note that the condition ^ < ^ < ^ is needed for absolute convergence of the 2-^1-series of g„. This 
condition can be removed by analytic continuation. □ 
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We define the Hilbert space Ai by 



M. = span|qn \n G Z>o|, 
then M consists of functions of the form 



The inner product on M is given by 



M 



9i{p) 



1 



Wo{p)/W,{p)\ ff,{p)\ Wo{p) 



\92ip)J \-Wo{p)/Wi{p) 



f2{p) 



1 



Wojp) 



ydp. (5.19) 



Proposition 5.20. The operator : Ai ^ L'^{M.,w{x)dx) is an isometry. 
Proof. Let 



f(p) 



h{p) 

f2{p) 



sip) 



9i{p) 
92{p)) ' 



We write out {J^{,J^g)i2( 



:,w{x)dx) 



explicitly 



lim 



N roo 



H^o(p) 



AT JO I 



VKo(p) 



'fp{x)fi{p) - v*p{x)fi{p) 



^p{x)f2{p) 



Wi{p) 



+ ^l{x)h{p)\dp 



, 1^ W^{a) 
Jo 1 _ typW 

^ Wiia) 



2 \ {x)gi [cf)-ipl {x)gi (a) ^= - (fa {x)g2 (o-) 7777^ + 'Pa {x)g2 (o-) ) da 



X w{x)dx 



lim 



JO 



Woip)Woia) 



Woip] 
Wi{p) 



- flip)g2{cr] 



+ 



+ 



+ 



f2{p)gi{cr) - f2{p)g2{cr) 



h{p)g2{cf) - fi{p)gi{cr] 



h{p)g2{'y) - f2{p)gi{cr] 



1 - 

Woja) 
Woja) 

Woja) 
Wi{a) 

Woja) 



Woja) 



f2{p)gi{<y. 



h{p)giW. 



f2{p)g2{cr. 



fi{p)g2{cr. 



- Wojp) 
Wiip) 

- Wojp) 

Wp) 
- Wojp) 
Wiip) 

-Woip) 



+ /2(p)52(cr) 



Woip)Woia) 



+ hip)g2i(j] 



Wiip)Wi{<j) 
Woip)Woi(y) 



+ hip)gii<y] 



Wiip)Wi{a) 
Woip)WQia) 



Wiip) 

Then from Propositions 15.121 15.141 and (|5.19|) we obtain 
by a straightforward calculation. 



+ fiip)gii(^] 



Wiip)Wi{a) 
Woip)Woia) 



Wiip)Wiia) 



{^p,'pI)n,n 

{^*p^'P*a)N,N 



□ 



So far we only considered the integral transform in the case that p"^ + ^ is in the continuous 
spectrum of the difference operator A. In the next subsection we consider the discrete spectrum of 
A. 
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5.4. Discrete spectrum. From (|5.8|) it follows that for Q{p) < we have ^p{x) G L'^{M.,w{x)dx). 
So if c{—p) = and 9(/3) < 0, we find from Proposition 15.91 that (pp{x) = c{p)^p{x), and therefore 
(Ppix) £ L'^{R,w{x)dx). 

There are two possible cases for c{—p) = 0, cf. Theorem 14.11 

(i) k2 — ki + ^ < 0, then p = i{k2 — ki + ^ + n), n = 0, . . . ,no, where no is the largest 
nonnegative integer such that A;2 — /ci + ^ + no < 0, 

(ii) /ci + /c2 — ^ < 0, then p = i{ki + k2 — \). 

Case (ii) does not occur for ki> 1, which is needed for convergence of the 3F2-series of ^p{x + i). 
However for /ci < 1 we use expression (|5.6() for $p(x) (which still converges if ki < 1) and <fp{x) = 
c{p)^p{x). We see that the 3i*2-series becomes a 2i*'i-series of unit argument, and then, with Gauss's 
summation formula, we find that in case (ii) we have ^p{x) = e~'^'^^p{x). Observe that case (i) and 
case (ii) exclude each other. 

First we consider case (i). For pn = i{k2 — /ci + | + n),0<n< no, we denote ifp{x) by (pp^{x). 
We show that cpp^ (x) is orthogonal to (pp^ (x) and 93*^ (x) for n ^ m. Note that ipp^ is given by a 
terminating series, cf. 1)5. 4() . 

Proposition 5.21. For m, n = 0, . . . , no 

i^Pn^V^pJ = ^nm ( 27ri Res Wo (p) 
5„ 



p=Pn 

g2t(</.-f ) Y{2k2)T{2ki - 2k2 - 1) n! (2/c2 - 2ki + n + 1)„(2 - 2ki)n 



T{ki -k2 + it)T{ki -k2- it)T{2ki - 1) (2A;2)„(2A:2 - 2ki + 2)2„ 
Proof. Writing out the explicit expressions ()5.4() for ipp^ (x) and ipp^ (x) gives 

fPnix)fp,^ix)wix)dx 

^^2t{0-|)J_ r p /-n,2k2-2ki+n+l,k2-ix \ 
2vry_oo^n 2A:2,A;2- + + l 'J 

r{k2 + ix) 



^ p . -m,2k2-2ki + m + l,k2 + ix _^ 
^ ^ ^ ' 2^2,^:2 -ki-it + 1 



-e 



T{ki + it + ix 

2t(</,-5) {-n)k{2k2 -2ki + n+ l)k{-m)i{2k2 - 2ki + m + 1 



2 

dx 



fc=o 1=0 ^K2A:2)fc(A;2 -ki+it + l)k U{2k2)i{k2 - ki - it + l)i 

^ J_ r r(fc2 -ix + k)Tik2 + ix + l) 
2tt r(A;i — it — ix)T{ki + it + ix) 

The integral inside the sum can be evaluated by [HI §3.3.4] 

1 r(a + s)r(c - s) , r(a + c)r(6 + d-a-c-l) 

-ds — 



2TTi J_,^ T{b + s)T{d - s) T{b - a)T{d - c)T{b + d - 1) ' 

where 3f?(a + c — b — d) < 1 and the path of integration separates the poles of T(a + s) from the 
poles of r(c — s). Note that the convergence condition 2k2 — 2ki + A: + / < 1 is satisfied in case (i) 
and k,l < no. Now we find for the double sum for n < m 



r{2k2)T{2ki - 2k2 - 1) 



T{ki -k2 + it)T{ki - k2 - it)T{2ki - 1) 

-n)fc(2A;2 - 2A:i + n + l)k {-m)i{2k2 -2ki+m + l)i{2k2 + k)i 



X 



Ey — n)k\^is,2 — -r n T ijfc ^ 



kl{2k2-2ki + 2)k ^ Il{2k2)l{2k2 - 2ki + k + 2)1 
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The sum over I is a terminating 3F2-series, which can be evaluated by the Pfaff-Saalschiitz theorem 

f-m,2k2-2ki + m + l,2k2 + k \ 1°' , , , k < m, 

V 2^2, 2^2 — 2ki + A; + 2 / , , , — ^ — , k = m. 

^ ^ y{2k2)ra{2k2-2ki + m + 2)J 

So we find for n < m 



g2i(<^-|) r(2A;2)r(2A;i - 2A;2 - 1) n! (2/c2 -2ki + n + 1)„(2 - 2k 



In 



T{ki -k2 + it)T{ki -k2- it)T{2ki - 1) {2k2)n{2k2 -2ki+n + 2)„(2A:2 - 2ki + 2)„ ' 

Note that from the condition A;2 — A;i + ^ + n<0 fohows that this expression is positive in case 
n = m. For n > m we find the same result by interchanging the summations over k and I. A 
straightforward calculation shows that the expression found is equal to 

-1 



5nm 27rz Res Wo (p) 

P=Pn 



□ 



Proposition 5.22. For m, n = 0, . . . , no 

i'fl^^'Pprn) =^nm ( 2TriResWi{p) 



e2f(0-f)r(2fc2)r(2fci-2fc2-l) 
" r(A:i -k2 + it)Tiki - k2 - it)T{2ki - 1) 

(-l)"n!(A:2 - ki + it + 1)„(2A:2 -2ki+n+ 1)„(2 - 2ki] 



X 



(A;2 - fci - it + l)„,(2fc2)n(2A;2 - 2ki + 2)2^ 
Proof. Prom the first formula on page 142 in ;1, we find 



v'pJ^) = (-i) — — TTT-rr-^^pJ^^- 



(/C2 - fcl - it + l)n 

(A;2 - /ci + it + 1)„ 

Then the explicit expression follows from Proposition 15.211 A straightforward calculation shows 
that the explicit expression is equal to the residue at /? = p„ of Wi (p) . □ 

A similar calculation is used for case (ii). Recall from the beginning of this subsection that in 
this case ^Pp^ix) = e~'^'^^ c{pc)p{x) . 

Proposition 5.23. Let p^ = i{ki + k2 — then 

-1 



(VpoV'pc) = 27ri Res Wo (p) 

* P=Pc 



=2i(<^-|) 



^.T{2k2)T{l - 2ki - 2k2 



T{k2 -ki+it + 1) 



T{ki + k2 + it)r(l -ki-k2 + it) 



T{l-2ki) 

Proof. The proof is similar to the proof of Proposition 15.211 □ 
Proposition 5.24. Let pc = i{ki + k2 — then 

{fl,^P.) = (27riResWi(p)) 

2t(<^-l) r(2fc2)r(i - 2ki - 2fc2)r(fc2 - fci - it + 1) 

~ ^ ' r(l - 2ki)T{ki + k2- it)r(l - fei - ^2 - it)r(A;i - /c2 + it)) ' 
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Proof. We use Euler's reflection formula to write p{x) in terms of F-functions, then we have 

/ * \ _ 2t(0-|)-^2^ f r(fc2 + ix)T{k2 - ix)T{ki - it- ix) 

{^P^,^pJ e ^^Pc) J^r{h+^t + ix)T{l-h-^t-^x)T{l-h-it-^x) 

We use a special case of f^Sl (4.5.1.2)] to evaluate the integral; 

1 T(a + s)T(b- s)T(c- s) , 

as = 



2vri J_i^ Tid + s)Tie-s)T{f-s) 

r{a + b)T{a + c) f a + b, a + c,l + a - d . 

■ 3^2 , , , ; t , 



T{d-a)T{a + e)T{a + f)-" " \ a + e,a + f 

where ?R.{d + e + f — a — b — c) >0 and the path of integration separates the poles of T(a + s) from 
the poles of r(6 — s) and T{c — s). We put 

s = —k2 + ix, a = 2k2, b = 0, c = ki — k2 — it, 
d = ki + k2 + it, e = 1 — ki — k2 — it, f = 1 — ki — k2 — it, 

then we find that the 3-F2-series reduces to a 2-^1-series, which can be evaluated by Gauss's sum- 
mation formula. Prom this the result follows. □ 

Next we show that if + | is in the discrete spectrum of A, (pp{x) is orthogonal to (pa{x) and 
(x), if a is real. 

Proposition 5.25. For a € [0, 00) and p = pn, or p = pc, we have 
Proof. By Propositions 15.31 and 15.71 

Af,M^oo 7_jv/ N,M-^oo p^ - 

We show that the limit of each Wronskian is zero. Let 

fix) = (ipp{x)ipl{x -i)- Lpp{x - i)Lpl{x)^a-{x)w{x). 

Pirst we consider the asymptotic behaviour of f{—M) and f{N). 

Por p = pn and < y < 1 we find from Lemmas 15.41 15.1UI and Proposition 15.91 

Por p = Pc we find 

Here the implied constants do not depend on y. Then dominated convergence gives the result. 
The proof for {ipp, (/?* ) = runs along the same lines. □ 

Remark 5.26. The explicit calculations in this subsection can be carried out because of the choice 
(|5.ci|) of the i-periodic function p{x). It is not likely that with another choice for the function p{x) 
all the calculations can be done explicitly. This gives another (heuristic) argument for the choice 
of p{x). 



36 WOLTER GROENEVELT, ERIK KOELINK, AND HJALMAR ROSENGREN 

5.5. The continuous Hahn integral transform. We combine the results of subsection 15 . .SI with 
the results of subsection 15.41 

Let A;i, A;2 > 0, < (/) < vr and t G M. Let (pp{x) be the function given by 

-^(^^-^^ ^ fk2-ix,k2-ki + ^ + ip,k2-ki + ^-ip 



^''^ ' T{ki+ix + it)T{ki-ix-it)^ ^\ 2k2,k2-ki+it + l ' 

We denote 

^p^-^oip)_ ri^ + it + ip)T{^ + it-ip) 



Wi{p) T{ki-k2 + it)T{k2-ki + it + l) 



^^^^ 2vr' 



r(A:2 -ki + l + ipfT{ki - ^2 + ^ + ip)T{ki + k2-^+ip) 



T{2k2)T{k2 -ki+it + l)T{2ip) 



2 



w{x) = ;^e(2^+*)(2<^~")|r(A;i+it + ix)r(/t2 + ^x)|2. 

ZTT 



Let A4 be the Hilbert space given by 



M = spanjqin | m £ Z>o|, 
where qm is as in Lemma 15.181 For functions f = ( '^^ ) , the inner product on Ai is given by: 

\t2j 



(i) Foi ki + ki - ^ > 0, k2 - ki + ^ > 





(ii) For ki + k2 - ^ < 0, Pc = i{ki + ^2 - 

(iii) For A:2 — /ci + ^ < 0, /)„ = i(A;2 — A;i + ^ + n), n = 0, . . . , no, where no is the largest integer 
such that —ipno < 0, 

no 



n=0 

Observe that for m > n we have qm(Pn) = 0. For m < n it follows from the way is calculated 
in Proposition 15.181 that qm{Pn) = h{pn)qm{pn)- 

For a continuous function f G we define the linear operator \ M ^ L'^{M.,w{x)dx) by 



M 



We call the continuous Hahn integral transform. 

Theorem 5.27. The continuous Hahn integral transfrom : M. ^ L?'{M.,w{x)dx) is unitary and 
its inverse is given by 

Ix. 
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Proof. For case (i) this follows from Propositions 15.161 15.191 and 15.201 

For case (ii) we only have to check that Propositions 15.121 and 15.141 still hold with the discrete 
mass point in p = pc added to the integral. From Propositions 15.231 15.241 and 15.251 we find 



0, 



a G [0, oo), 
2TTiResWo{a) ] f{pc), cf = Pc 

(7=pc 



0, 



a G [0, oo), 



2mResWi{a)] f{pc), a = pc- 

(7=pc 



Now the proof for case (ii) is completely analogous to the proof of case (i) . 

For case (iii) injectivity and surjectivity of can be proved in the same way as case (i). We 
check that J- is an isometry. The continuous part follows from Proposition 15 . 2Ul so we only have to 
check for the discrete part. We write out (.^qio -^qOLaj-iR k,l G Z>o, for the discrete part of 

jFqk and jFqi. From Propositions l5.2HI5.22l and qk{Pn) = HPn)Qk{Pn) we find, for n, m = 0, . . . , no, 



no 



n=0 
no 

X 

m=0 
no 



['Ppn(.x)qkiPn) + Vpjx)qk{pn)) m ResWo(p) 

^ ^ P—P'n. 

no 

\'^Pr^{x)qi{pm) + ^*p^{x)qi{pm)) m Res Wo{p) w{x)dx 

\ / P — Pm 

m=0 

'0 , 

X] ('lk{pn)qiipm){^p„,y^*pj +qkipn)qi{pm){y^pn,^pj + qk{pn)qi{pm){v*p„, V\ 



n.m=0 



+ qk{pn)qi{pni){'f*p,^,'^pj) (vri) ResWo{p) Res Wq{p) 



P=Pn 



P=Pm 



no 



n=0 



yZ \ 'lk{Pn)qi{Pn) + qk{Pn)qi{Pn)] TTZ ResWo(p) 

^ ' ^ p=Pn 



Here we recognize the discrete part of the inner product (qkiqi)A^- Combined with Propositions 
I5.2UI and 15.251 this shows that J- acts isometric on the basis elements qk- By linearity J-" extends to 
an isometry. □ 

The continuous Hahn integral transform in case (i) corresponds exactly to the integral transform 
we found in H4.3l bv formal computations. 



Remark 5.28. Let us denote the operator A by A{ki, k2,t), let w(x) = w{x; ki, k2,t), and let 
Tt denote the shift operator. Observe that w^x + t;k2,ki,—t) = w{x;ki,k2,t). It is clear that 
L'^{M.,w{x; ki, k2,t)dx) is invariant under the action of Tf. A short calculation shows that T_f o 
A(A;i,A;2,t) o Tt = A{k2,ki,—t), so ipp{x + t; —t, k2, ki, (p) is an eigenfunction of A{ki,k2,t) for 
eigenvalue p"^ + j. Going through the whole machinery of this section again, then gives another 
spectral measure of A(/ci, k2,t), namely the one we found with ki ^ k2, k2^ ki and 1 1— > —t. 

Finally we compare the spectrum of the difference operator A with the tensor product decomposi- 
tion in Theorem 14. 11 The discrete term in case (ii) in this section corresponds to one complementary 
series representation in the tensor product decomposition in Theorem l4.1l Case (iii) does not occur 
in Theorem 14.11 since it is assumed that ki < k2- If we no longer assume this, the discrete terms 
in case (iii) correspond to a finite number of positive discrete series representations. 
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The finite number of negative discrete series in Theorem 14.11 can be obtained as described in 
Remark 15.281 In order to obtain the Clebsch-Gordan coefficients in this case from the summation 
formula in Theorem 13.11 we need to consider different overlap coefficients for the continuous se- 
ries representations. Let Vn{x;X,e,(j)) := A, — e, tt — (/>), where Un is the Meixner-Pollaczek 
function as defined by (|2.5j) . Then 

= fvn{x;-^ + ip,e,iT - c 

is a generalized eigenvector of 7r^'^(X(^), see |14| §4.4.11]. From Theorem l3.H with {ki, k2,xi,X2,p) 

(A;2, fci, xo, xi, — p) we find the Clebsch-Gordan coefficients for the eigenvector I '^^1 

and these Clebsch-Gordan coefficients are multiples of continuous Hahn functions ipp{xi;x2 — 
xi, ^2, fei, (/>) and ip*p{xi]X2 — Xi,k2,ki,(l)). In this case the discrete mass points in the measure 
for the continuous Hahn transform correspond to one complementary series representation, or a 
finite number of negative discrete series representations 
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